Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 1.7B Instruct
SmolLM · HuggingFaceTB
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
OM
D1 Omni 2B
Omni · LiquidAI
Params1.73B
Context125K
Smallest1.8 GB
ReasoningTool useVision
GI
GigaAM v3 CTC
Gigaam · handy-computer
Params221M
Context—
Q4_K_M0.2 GB
GGUF
QW
Dolphin3.0 Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
QW
Huihui Qwen3.5 2B Abliterated
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
LF
LFM2 1.2B
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
JU
Julia-1
Julia · ggml-org
Params144M
Context8K
Smallest0.2 GB
GGUF
AV
ava lfm25 toolcall
Ava · vitorcalvi
Params1.17B
Context125K
Smallest0.7 GB
GGUF
AN
Anima Turbo V1.1
Anima · vanes430
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF
NS
NSFW flash
Nsfw · UnfilteredAI
Params2.24B
Context4K
Q4_K_M1.4 GB
GGUF
MI
MiniCPM5 2B heretic abliterated
MiniCPM · Abiray
Params2.52B
Context128K
Q4_K_M1.6 GB
GGUF
EM
Embeddinggemma 300m Qat Q4_0 Unquantized
Embeddinggemma · unsloth
Params303M
Context2K
Smallest0.3 GB
Embedding
ZO
ZONOS2
Zonos · Zyphra
Params64M
Context—
Smallest0.0 GB
GGUF
QW
Qwen2.5 3B Instruct Uncensored
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
MI
Ministral-3-3B-Reasoning-2512
Mistral · unsloth
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningVision
PA
PaddleOCR VL 1.6
Paddleocr · LunarOilRig
Params467M
Context128K
Q4_K_M0.3 GB
Vision
GE
Gemmasutra Mini 2B v1
Gemma · TheDrummer
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MO
MOSS-Transcribe-Diarize 0.9B
Moss · handy-computer
Params909M
Context—
Q4_K_M0.6 GB
GGUF
PA
Parakeet RNN-T 1.1B
Parakeet · handy-computer
Params1.07B
Context—
Q4_K_M0.8 GB
GGUF
QW
Qwen1.5-0.5B-Chat-AWQ-fp16
Qwen · Qwen
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
HU
HunyuanOCR
Hunyuanocr · prithivMLmods
Params539M
Context128K
Q4_K_M0.4 GB
Vision
DR
dreamshaper xl v2 turbo
Dreamshaper · off-grid-ai
Params3.47B
Context—
Smallest2.8 GB
GGUF
QW
Jev Style Qwen3.5 2B Decision
Qwen · chaoliangUNSW
Params1.94B
Context256K
Q4_K_M1.3 GB
GGUF
LT
LTX Video 0.9.6 distilled
Ltx · city96
Params1.92B
Context—
Q4_K_M1.3 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
MI
MiniCPM V 4.7 1B abliterated heretic
MiniCPM · Abiray
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
QW
Sakura 1.5B Qwen2.5 v1.0 GGUF IMX
Qwen · shing3232
Params1.78B
Context128K
Smallest1.3 GB
GGUF
GE
avemio digital gemma 2b Sft pretrain 6000 steps merge
Gemma · RichardErkhov
Params2.5B
Context8K
Q4_K_M1.6 GB
GGUF
MI
Sharp MiniCPM5 2B
MiniCPM · peculiar-ragdoll
Params2.52B
Context—
Smallest0.0 GB
GGUF
QW
qwen3 tts 1.7b customvoice
Qwen · cstr
Params1.92B
Context—
Smallest2.0 GB
GGUF

Other sizes

Keep browsing