Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Bella Bartender Qwen3.5 2b
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
SM
SmolLM 1.7B
SmolLM · bartowski
Params1.71B
Context2K
Q4_K_M1.1 GB
GL
GLM OCR
GLM · mradermacher
Params891M
Context128K
Q4_K_M0.5 GB
QW
qwen3 tts 0 6b custom voice mix precision
Qwen · Arm
Params83M
Context8K
Smallest0.0 GB
ST
stable diffusion v1 5
Stable · kostakoff
Params1.07B
Context—
Smallest2.2 GB
QW
Qwen2.5 3B Instruct
Qwen · ThomasBaruzier
Params3.09B
Context32K
Q4_K_M1.9 GB
LL
harborwater_open-llama-3b-v2-wizard-evol-instuct-v2-196k
Llama · TheBloke
Params3.43B
Context2K
Q4_K_M2.6 GB
MO
moondream2
Moondream · moondream
Params1.42B
Context2K
Smallest2.8 GB
EX
EXAONE-4.0-1.2B
Exaone · LGAI-EXAONE
Params1.28B
Context64K
Q4_K_M0.8 GB
JU
juggernaut xl v9
Juggernaut · off-grid-ai
Params3.47B
Context—
Smallest3.0 GB
PH
Phi 2 OmniMatrix i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
QW
Onego_Osearch_Popular_Wiki_Qwen05B_V2_Merged
Qwen · onegoai
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen2.5 Coder 0.5B Instruct Gensyn Swarm tall tame panther
Qwen · 0xgr3y
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen2.5 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GP
Gpt2 Medium
Gpt · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
QW
qwen3 forced aligner 0.6b
Qwen · cstr
Params918M
Context—
Smallest0.5 GB
MA
madlad400 3b mt
Madlad · cstr
Params2.94B
Context—
Smallest0.0 GB
MI
colgrep-agent-2B
MiniCPM · lightonai
Params2.52B
Context128K
Q4_K_M1.6 GB
QW
Huihui Qwen3.5 0.8B Abliterated
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3 VL Embedding 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen3-ASR-1.7B
Qwen · FlippyDora
Params2.35B
Context—
Smallest3.2 GB
DE
decider 2b
Decider · Mapika
Params1.88B
Context256K
Q4_K_M1.3 GB
GR
Granite 4.0 H 350m
Granite · ibm-granite
Params340M
Context1024K
Q4_K_M0.2 GB
QW
Qwen2-0.5B
Qwen · legraphista
Params494M
Context128K
Smallest0.3 GB
DR
TokForge DreamShaper LCM GGUF q4
Dreamshaper · darkmaniac7
Params1.07B
Context—
Smallest1.6 GB
QW
qwen3 asr 0.6b
Qwen · cstr
Params938M
Context—
Smallest0.0 GB
QW
qwen3 tts 12hz 1.7b ru stress
Qwen · sknyazev
Params142M
Context32K
Smallest0.2 GB
CY
CyberRealisticXL
Cyberrealisticxl · InsecureErasure
Params2.57B
Context—
Q4_K_M1.6 GB
GR
granite-3b-code-instruct
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
MI
MiniCPM V 4_6 Thinking
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB