Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
UN
Unlimited OCR
Unlimited · sabafallah
Params2.93B
Context—
Q4_K_M2.0 GB
MI
MiniCPM5 1B Claude Opus Fable5 V2 Thinking heretic
MiniCPM · saidutta69
Params1.08B
Context128K
Q4_K_M0.7 GB
QW
Qwen3.8-Flash-Next-DFlash2
Qwen · incoai
Params603M
Context256K
Q4_K_M0.4 GB
MI
Ministral 3 3B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · unsloth
Params3.09B
Context128K
Q4_K_M1.9 GB
WH
Whisper Base (English)
Whisper · handy-computer
Params73M
Context—
Q4_K_M0.1 GB
GR
Granite 3b Code Instruct
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
QW
Qwen3.5 9B Uncensored HauhauCS Aggressive MTP GGUF NVFP4
Qwen · AIconjured
Params456M
Context256K
Smallest6.3 GB
QW
Qwen2-1.5B
Qwen · legraphista
Params1.54B
Context128K
Smallest0.4 GB
LL
Llama 3.2 1b Abliterated
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
LF
Lfm2.5 2.6b Fable5 Coding Agent Heretic
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
CO
Cosmos Reason2 2b
Cosmos · apolo13x
Params2.03B
Context256K
Q4_K_M1.3 GB
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
PR
Privacy Filter
Privacy · LocalAI-io
Params1.4B
Context128K
Smallest1.6 GB
MI
MiniCPM5 2B DSpark
MiniCPM · openbmb
Params324M
Context128K
Smallest0.7 GB
PY
Pythia 410m Deduped
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
QW
Qwen3.8 2B Distill Heretic
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
AU
Audar ASR V1 Turbo
Audar · audarai
Params2.03B
Context64K
Q4_K_M1.3 GB
QW
Qwen2-1.5B-Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
KI
Kisoku 1.6b Chat
Kisoku · mradermacher
Params1.6B
Context128K
Q4_K_M1.0 GB
HU
Hunyuan 1.8B Instruct
Hunyuan · bartowski
Params1.79B
Context256K
Q4_K_M1.1 GB
GR
Granite 3b Code Base 128k
Granite · RichardErkhov
Params3.48B
Context125K
Q4_K_M2.1 GB
AU
Audar TTS V1 Turbo
Audar · audarai
Params1.64B
Context32K
Q4_K_M1.1 GB
GR
Granite 4.0 350m
Granite · ibm-granite
Params352M
Context32K
Q4_K_M0.2 GB
MI
Ministral 3 3B Reasoning 2512
Mistral · bartowski
Params3.43B
Context256K
Q4_K_M2.1 GB
LL
Hermes 3 Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
ST
StartLux Decision v1 0.8B Q8 0
Startlux · startlux-models
Params752M
Context256K
Smallest0.8 GB
QW
Qwen3.5 2B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
GE
Gemma 2 2b It
Gemma · lmstudio-community
Params2.61B
Context8K
Q4_K_M1.7 GB
ST
stable-code-instruct-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB