Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Bella Bartender Qwen3.5 2b
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
SM
SmolLM 1.7B
SmolLM · bartowski
Params1.71B
Context2K
Q4_K_M1.1 GB
Tool use
GL
GLM OCR
GLM · mradermacher
Params891M
Context128K
Q4_K_M0.5 GB
Vision
QW
qwen3 tts 0 6b custom voice mix precision
Qwen · Arm
Params83M
Context8K
Smallest0.0 GB
GGUF
ST
stable diffusion v1 5
Stable · kostakoff
Params1.07B
Context—
Smallest2.2 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · ThomasBaruzier
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
LL
harborwater_open-llama-3b-v2-wizard-evol-instuct-v2-196k
Llama · TheBloke
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
MO
moondream2
Moondream · moondream
Params1.42B
Context2K
Smallest2.8 GB
Vision
EX
EXAONE-4.0-1.2B
Exaone · LGAI-EXAONE
Params1.28B
Context64K
Q4_K_M0.8 GB
GGUF
JU
juggernaut xl v9
Juggernaut · off-grid-ai
Params3.47B
Context—
Smallest3.0 GB
GGUF
PH
Phi 2 OmniMatrix i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
QW
Onego_Osearch_Popular_Wiki_Qwen05B_V2_Merged
Qwen · onegoai
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen2.5 Coder 0.5B Instruct Gensyn Swarm tall tame panther
Qwen · 0xgr3y
Params494M
Context32K
Q4_K_M0.4 GB
Coding
QW
Qwen2.5 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
GP
Gpt2 Medium
Gpt · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
QW
qwen3 forced aligner 0.6b
Qwen · cstr
Params918M
Context—
Smallest0.5 GB
GGUF
MA
madlad400 3b mt
Madlad · cstr
Params2.94B
Context—
Smallest0.0 GB
GGUF
MI
colgrep-agent-2B
MiniCPM · lightonai
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingTool use
QW
Huihui Qwen3.5 0.8B Abliterated
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen3 VL Embedding 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingVision
QW
Qwen3-ASR-1.7B
Qwen · FlippyDora
Params2.35B
Context—
Smallest3.2 GB
GGUF
DE
decider 2b
Decider · Mapika
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
GR
Granite 4.0 H 350m
Granite · ibm-granite
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
QW
Qwen2-0.5B
Qwen · legraphista
Params494M
Context128K
Smallest0.3 GB
GGUF
DR
TokForge DreamShaper LCM GGUF q4
Dreamshaper · darkmaniac7
Params1.07B
Context—
Smallest1.6 GB
GGUF
QW
qwen3 asr 0.6b
Qwen · cstr
Params938M
Context—
Smallest0.0 GB
GGUF
QW
qwen3 tts 12hz 1.7b ru stress
Qwen · sknyazev
Params142M
Context32K
Smallest0.2 GB
GGUF
CY
CyberRealisticXL
Cyberrealisticxl · InsecureErasure
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
GR
granite-3b-code-instruct
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
MI
MiniCPM V 4_6 Thinking
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningVision

Other sizes

Keep browsing