Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
SM
SmolLM2 1.7B Instruct
SmolLM · HuggingFaceTB
Params1.71B
Context8K
Q4_K_M1.1 GB
OM
D1 Omni 2B
Omni · LiquidAI
Params1.73B
Context125K
Smallest1.8 GB
GI
GigaAM v3 CTC
Gigaam · handy-computer
Params221M
Context—
Q4_K_M0.2 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Huihui Qwen3.5 2B Abliterated
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
LF
LFM2 1.2B
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
JU
Julia-1
Julia · ggml-org
Params144M
Context8K
Smallest0.2 GB
AV
ava lfm25 toolcall
Ava · vitorcalvi
Params1.17B
Context125K
Smallest0.7 GB
AN
Anima Turbo V1.1
Anima · vanes430
Params2.09B
Context—
Q4_K_M1.4 GB
NS
NSFW flash
Nsfw · UnfilteredAI
Params2.24B
Context4K
Q4_K_M1.4 GB
MI
MiniCPM5 2B heretic abliterated
MiniCPM · Abiray
Params2.52B
Context128K
Q4_K_M1.6 GB
EM
Embeddinggemma 300m Qat Q4_0 Unquantized
Embeddinggemma · unsloth
Params303M
Context2K
Smallest0.3 GB
ZO
ZONOS2
Zonos · Zyphra
Params64M
Context—
Smallest0.0 GB
QW
Qwen2.5 3B Instruct Uncensored
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
Ministral-3-3B-Reasoning-2512
Mistral · unsloth
Params3.43B
Context256K
Q4_K_M2.1 GB
PA
PaddleOCR VL 1.6
Paddleocr · LunarOilRig
Params467M
Context128K
Q4_K_M0.3 GB
GE
Gemmasutra Mini 2B v1
Gemma · TheDrummer
Params2.61B
Context8K
Q4_K_M1.7 GB
MO
MOSS-Transcribe-Diarize 0.9B
Moss · handy-computer
Params909M
Context—
Q4_K_M0.6 GB
PA
Parakeet RNN-T 1.1B
Parakeet · handy-computer
Params1.07B
Context—
Q4_K_M0.8 GB
QW
Qwen1.5-0.5B-Chat-AWQ-fp16
Qwen · Qwen
Params620M
Context32K
Q4_K_M0.4 GB
HU
HunyuanOCR
Hunyuanocr · prithivMLmods
Params539M
Context128K
Q4_K_M0.4 GB
DR
dreamshaper xl v2 turbo
Dreamshaper · off-grid-ai
Params3.47B
Context—
Smallest2.8 GB
QW
Jev Style Qwen3.5 2B Decision
Qwen · chaoliangUNSW
Params1.94B
Context256K
Q4_K_M1.3 GB
LT
LTX Video 0.9.6 distilled
Ltx · city96
Params1.92B
Context—
Q4_K_M1.3 GB
SM
SmolLM2 135M Instruct
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
MI
MiniCPM V 4.7 1B abliterated heretic
MiniCPM · Abiray
Params1.01B
Context256K
Q4_K_M0.7 GB
QW
Sakura 1.5B Qwen2.5 v1.0 GGUF IMX
Qwen · shing3232
Params1.78B
Context128K
Smallest1.3 GB
GE
avemio digital gemma 2b Sft pretrain 6000 steps merge
Gemma · RichardErkhov
Params2.5B
Context8K
Q4_K_M1.6 GB
MI
Sharp MiniCPM5 2B
MiniCPM · peculiar-ragdoll
Params2.52B
Context—
Smallest0.0 GB
QW
qwen3 tts 1.7b customvoice
Qwen · cstr
Params1.92B
Context—
Smallest2.0 GB