Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Huihui Qwen3.5 2B Abliterated Athanorlite ORPO
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
QW
Qwen3Guard Gen 0.6B
Qwen · QuantFactory
Params752M
Context32K
Q4_K_M0.5 GB
Reasoning
QW
Qwen3.5 2B GPT 5.1 HighIQ Deep Thinking
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
QW
Connectailab CHOCO BRAIN v1 Merged
Qwen · hwihwalab
Params752M
Context256K
Smallest0.8 GB
ReasoningTool use
OU
OuteTTS 0.3 500M
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
GGUF
DG
Dgpl Linux Assistant 0.8b
Dgpl · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen3.8-27B-DFlash2
Qwen · andrew-paul
Params1.92B
Context256K
Smallest0.7 GB
ReasoningTool use
MO
Morrow 2.6B CE
Morrow · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
GGUF
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
TE
TeenyTinyLlama 460m Chat
Teenytinyllama · afrideva
Params468M
Context2K
Q4_K_M0.3 GB
GGUF
CH
Chinese Emotion
Chinese · mradermacher
Params560M
Context512
Q4_K_M0.4 GB
GGUF
QW
Qwen3.5_2B_Finetune_Uncensor
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
LF
LFM2.5 2.6B Absolute Heresy
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
GGUF
PA
parakeet tdt ctc 110m
Parakeet · cstr
Params115M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.5 2B Base Heretic
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
FL
FLAMA 0.5 3B
Flama · xaviviro
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
QW
Qwen3.5 2B Base
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
ME
melotts en v2
Melotts · cstr
Params95M
Context—
Smallest0.1 GB
GGUF
FA
Falcon H1 Tiny Coder 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB
Coding
NO
notHumpback-Myx
Nothumpback · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
SP
Spark X2.6 1.7B
Spark · bartowski
Params1.71B
Context1024K
Q4_K_M1.1 GB
ReasoningTool use
JI
jina-reranker-v3
Jina · jinaai
Params596M
Context128K
Q4_K_M0.4 GB
Embedding
MI
MiniCPM5 2B
MiniCPM · XtrCom
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
ST
stable-code-instruct-3b
Stable · bartowski
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
DE
YoungAi DeepSeek V4.1 Flash 1017
DeepSeek · wenzhouwu
Params485M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.5 0.8B GPT 6 Astra Luna Fable 5.1 Opus 5.5 Distill Karpy
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
QW
Qwen 2.5 3b RP
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M2.1 GB
RoleplayTool use
GR
granite speech 4.0 1b
Granite · cstr
Params2.31B
Context—
Smallest2.9 GB
GGUF
GR
Ibm Granite_Granite 4.0 Micro
Granite · lmstudio-community
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GE
Gemma 2b It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF

Other sizes

Keep browsing