Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
UN
Unlimited OCR
Unlimited · sabafallah
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
MI
MiniCPM5 1B Claude Opus Fable5 V2 Thinking heretic
MiniCPM · saidutta69
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningRoleplayTool use
QW
Qwen3.8-Flash-Next-DFlash2
Qwen · incoai
Params603M
Context256K
Q4_K_M0.4 GB
ReasoningTool use
MI
Ministral 3 3B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningVision
QW
Qwen2.5 Coder 3B Instruct
Qwen · unsloth
Params3.09B
Context128K
Q4_K_M1.9 GB
Coding
WH
Whisper Base (English)
Whisper · handy-computer
Params73M
Context—
Q4_K_M0.1 GB
GGUF
GR
Granite 3b Code Instruct
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
QW
Qwen3.5 9B Uncensored HauhauCS Aggressive MTP GGUF NVFP4
Qwen · AIconjured
Params456M
Context256K
Smallest6.3 GB
Vision
QW
Qwen2-1.5B
Qwen · legraphista
Params1.54B
Context128K
Smallest0.4 GB
GGUF
LL
Llama 3.2 1b Abliterated
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LF
Lfm2.5 2.6b Fable5 Coding Agent Heretic
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
Tool use
CO
Cosmos Reason2 2b
Cosmos · apolo13x
Params2.03B
Context256K
Q4_K_M1.3 GB
ReasoningVision
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PR
Privacy Filter
Privacy · LocalAI-io
Params1.4B
Context128K
Smallest1.6 GB
GGUF
MI
MiniCPM5 2B DSpark
MiniCPM · openbmb
Params324M
Context128K
Smallest0.7 GB
CodingTool use
PY
Pythia 410m Deduped
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
QW
Qwen3.8 2B Distill Heretic
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
AU
Audar ASR V1 Turbo
Audar · audarai
Params2.03B
Context64K
Q4_K_M1.3 GB
CodingVision
QW
Qwen2-1.5B-Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
GGUF
KI
Kisoku 1.6b Chat
Kisoku · mradermacher
Params1.6B
Context128K
Q4_K_M1.0 GB
Tool use
HU
Hunyuan 1.8B Instruct
Hunyuan · bartowski
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
GR
Granite 3b Code Base 128k
Granite · RichardErkhov
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
AU
Audar TTS V1 Turbo
Audar · audarai
Params1.64B
Context32K
Q4_K_M1.1 GB
GGUF
GR
Granite 4.0 350m
Granite · ibm-granite
Params352M
Context32K
Q4_K_M0.2 GB
GGUF
MI
Ministral 3 3B Reasoning 2512
Mistral · bartowski
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningVision
LL
Hermes 3 Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
ST
StartLux Decision v1 0.8B Q8 0
Startlux · startlux-models
Params752M
Context256K
Smallest0.8 GB
GGUF
QW
Qwen3.5 2B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningRoleplayVision
GE
Gemma 2 2b It
Gemma · lmstudio-community
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
ST
stable-code-instruct-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding

Other sizes

Keep browsing