Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Huihui Qwen3.5 2B Abliterated Athanorlite ORPO
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3Guard Gen 0.6B
Qwen · QuantFactory
Params752M
Context32K
Q4_K_M0.5 GB
QW
Qwen3.5 2B GPT 5.1 HighIQ Deep Thinking
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Connectailab CHOCO BRAIN v1 Merged
Qwen · hwihwalab
Params752M
Context256K
Smallest0.8 GB
OU
OuteTTS 0.3 500M
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
DG
Dgpl Linux Assistant 0.8b
Dgpl · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3.8-27B-DFlash2
Qwen · andrew-paul
Params1.92B
Context256K
Smallest0.7 GB
MO
Morrow 2.6B CE
Morrow · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
TE
TeenyTinyLlama 460m Chat
Teenytinyllama · afrideva
Params468M
Context2K
Q4_K_M0.3 GB
CH
Chinese Emotion
Chinese · mradermacher
Params560M
Context512
Q4_K_M0.4 GB
QW
Qwen3.5_2B_Finetune_Uncensor
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
LF
LFM2.5 2.6B Absolute Heresy
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
PA
parakeet tdt ctc 110m
Parakeet · cstr
Params115M
Context—
Smallest0.1 GB
QW
Qwen3.5 2B Base Heretic
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
FL
FLAMA 0.5 3B
Flama · xaviviro
Params3.43B
Context2K
Q4_K_M2.6 GB
QW
Qwen3.5 2B Base
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ME
melotts en v2
Melotts · cstr
Params95M
Context—
Smallest0.1 GB
FA
Falcon H1 Tiny Coder 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB
NO
notHumpback-Myx
Nothumpback · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
SP
Spark X2.6 1.7B
Spark · bartowski
Params1.71B
Context1024K
Q4_K_M1.1 GB
JI
jina-reranker-v3
Jina · jinaai
Params596M
Context128K
Q4_K_M0.4 GB
MI
MiniCPM5 2B
MiniCPM · XtrCom
Params2.52B
Context128K
Q4_K_M1.6 GB
ST
stable-code-instruct-3b
Stable · bartowski
Params2.8B
Context16K
Q4_K_M1.7 GB
DE
YoungAi DeepSeek V4.1 Flash 1017
DeepSeek · wenzhouwu
Params485M
Context—
Smallest0.1 GB
QW
Qwen3.5 0.8B GPT 6 Astra Luna Fable 5.1 Opus 5.5 Distill Karpy
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen 2.5 3b RP
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M2.1 GB
GR
granite speech 4.0 1b
Granite · cstr
Params2.31B
Context—
Smallest2.9 GB
GR
Ibm Granite_Granite 4.0 Micro
Granite · lmstudio-community
Params3.4B
Context128K
Q4_K_M2.1 GB
GE
Gemma 2b It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB