Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
Parakeet RNN-T 0.6B
Parakeet · handy-computer
Params617M
Context—
Q4_K_M0.5 GB
GGUF
CO
Cohere Transcribe
Cohere · handy-computer
Params2.05B
Context—
Q4_K_M1.6 GB
GGUF
TI
TIPO v2.1 1B A200M
Tipo · KBlueLeaf
Params1.01B
Context4K
Smallest1.1 GB
CodingVision
SM
SmolLM2 135M
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
MI
MiniCPM5 2B
MiniCPM · bartowski
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingTool use
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
Coding
GL
GLM 5.3 Flash UNCENSORED mlx oQ8e DFlash2
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest2.4 GB
Vision
MA
ms marco MiniLM L6 v2 Q8 0
Marco · sinjab
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
GR
Granite 4.1 3b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
WH
Whisper Small (English)
Whisper · handy-computer
Params242M
Context—
Q4_K_M0.2 GB
GGUF
GE
Assistant
Gemma · RachidAR
Params420M
Context128K
Smallest0.2 GB
GGUF
PA
Parakeet CTC 1.1B
Parakeet · handy-computer
Params1.06B
Context—
Q4_K_M0.8 GB
GGUF
QW
Qwen2.5 1.5B Instruct uncensored
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
D1
d1 2B
LiquidAI
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
MI
MiniCPM V 4.7 1B LocalAI
MiniCPM · weareapexcreators
Params1.01B
Context256K
Smallest1.1 GB
Vision
NA
vllm-d3-nano
Nano · ggml-org
Params2.4B
Context256K
Smallest2.6 GB
Vision
HA
Harrier Oss v1 0.6b
Harrier · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen3-Vl-2B-Thinking
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
ReasoningVision
QW
Qwen3.5 4B heretic imatrix
Qwen · FadedRedStar
Params334M
Context256K
Q4_K_M2.7 GB
CodingVision
QW
Qwen2.5 VL 3B Instruct
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
XX
encoder
Xxl · chatpig
Params219M
Context512
Q4_K_M2.9 GB
Coding
OR
Ornith 1.5 9b Mtp
Ornith · protoLabsAI
Params456M
Context256K
Q4_K_M5.8 GB
Vision
LF
LiquidAI_LFM2.5 1.2B Instruct
Lfm · lmstudio-community
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
CE
mispeech/ced-tiny
Ced · mudler
Params86M
Context—
Smallest0.0 GB
GGUF
FU
Fun ASR Nano
Fun · FunAudioLLM
Params234M
Context—
Smallest0.5 GB
GGUF
MI
MiniCPM5 2B Math
MiniCPM · Caldalis
Params2.52B
Context128K
Q4_K_M1.6 GB
Reasoning
QW
Qwen3.6 35B Uncensored HauhauCS 1M
Qwen · satgeze
Params447M
Context1024K
Q4_K_M21.7 GB
Vision
MI
MiniCPM V 4.7 1B heretic
MiniCPM · saidutta69
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningRoleplayTool use
DA
DanTagGen beta
Dantaggen · KBlueLeaf
Params393M
Context512
Smallest0.3 GB
GGUF
OR
Ornith 1.5 35B A3B
Ornith · SC117
Params447M
Context256K
Smallest14.4 GB
ReasoningVision

Other sizes

Keep browsing