Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
AB
Absolute_Zero_Reasoner Coder 3b
Absolute · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
QW
Qwen Image 2.1 PE T2I Pocket 0.8B
Qwen · ML-Intern-lab
Params752M
Context256K
Smallest0.8 GB
GGUF
PI
pixart
Pixart · calcuis
Params611M
Context—
Q4_K_M1.0 GB
GGUF
GR
Granite-4.0-H-350M
Granite · unsloth
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
GE
Gemma 2 2B ArliAI RPMax v1.1
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
UN
baidu.Unlimited OCR
Unlimited · DevQuasar
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
KU
KURE v3
Kure · mradermacher
Params1.14B
Context256K
Q4_K_M0.7 GB
GGUF
ST
Starcoder2 3b
StarCoder · QuantFactory
Params3.03B
Context16K
Q4_K_M1.9 GB
Coding
PH
Phi 2 Hyper
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
BT
btc chords
Btc · cstr
Params3M
Context—
Smallest0.0 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
CodingTool use
IN
Internlm2 Math Plus 1_8b
InternLM · mradermacher
Params1.89B
Context8K
Q4_K_M1.2 GB
GGUF
RE
Rex Frame 3B
Rex · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
DO
Dolphin v2
Dolphin · prithivMLmods
Params3.1B
Context125K
Q4_K_M1.9 GB
CodingVision
MI
MiniCPM-OCR 1.0 DSpark
MiniCPM · openbmb
Params297M
Context256K
Q4_K_M0.2 GB
ReasoningTool useVision
MI
MiniCPM V 4.7 1B CRACK
MiniCPM · dealignai
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
LO
Loopl Vl 2b
Loopl · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
Tool useVision
FA
Falcon H1 1.5B Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
QW
Qwen3 0.6B BrowserAgent
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
ZE
Zentiq Trained God Core
Zentiq · Prince909097628
Params2.02B
Context128K
Smallest1.0 GB
Tool use
IN
Index Echo S2ST 2B
Index · IndexTeam
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
QW
Qwen3.5 35B A3B Uncensored Heretic v2 Native MTP Preserved
Qwen · llmfan46
Params447M
Context256K
Q4_K_M21.8 GB
Vision
QW
Qwen2.5 0.5B Instruct 3MPER0RR Abliterated
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
VI
Mythos Nano Final
Vibethinker · squ11z1
Params3.1B
Context128K
Q4_K_M1.9 GB
CodingReasoning
YU
YuLan Mini
Yulan · bartowski
Params2.42B
Context28K
Q4_K_M1.8 GB
Coding
JI
jina embeddings v5 omni nano classification
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
EmbeddingVision
MI
Huihui MiniCPM V 4.6 Abliterated
MiniCPM · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
ari paraphraser 1.5b
Qwen · sriyuth
Params1.54B
Context32K
Smallest1.0 GB
GGUF
HO
K2-Horizon-0.9B
Horizon · bartowski
Params1.08B
Context128K
Q4_K_M0.7 GB
Reasoning
QW
Qwen2.5 Coder 0.5B Instruct heretic
Qwen · saidutta69
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use

Other sizes

Keep browsing