Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
OV
OvisOCR3
Ovisocr · michalland
Params752M
Context256K
Smallest0.8 GB
QW
Qwen2.5 0.5B Instruct uncensored
Qwen · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
EM
Embeddinggemma 2
Embeddinggemma · BennyDaBall
Params271M
Context256K
Smallest0.2 GB
MU
Muse Glimmer 30B DFlash
Muse · magnitudedev
Params2.56B
Context128K
Smallest1.6 GB
QW
s1-mini
Qwen · Mungert
Params752M
Context40K
Q4_K_M0.5 GB
GR
granite-3b-code-instruct
Granite · SanctumAI
Params3.48B
Context2K
Q4_K_M2.1 GB
SU
SupraTitle 50M
Supra · SupraLabs
Params52M
Context5K
Q4_K_M0.0 GB
GE
gemma 4 E4B it qat MTP
Gemma · magnitudedev
Params78M
Context128K
Smallest0.1 GB
GE
Gemma 3 1b Pt
Gemma · gguf-org
Params1B
Context32K
Q4_K_M0.8 GB
SM
SmolVLM2 500M Video Instruct
Smolvlm · second-state
Params409M
Context8K
Q4_K_M0.3 GB
ST
Kyutai-STT
Stt · cstr
Params1.05B
Context—
Smallest0.7 GB
GO
goppa ai Goppa LogiLlama
Goppa · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
MO
Morrow 2.6B
Morrow · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
NE
nexus science
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
LF
LFM2.5 8B A1B DSpark Draft v1
Lfm · magnitudedev
Params328M
Context125K
Smallest0.4 GB
MA
Mamba 2.8b Hf
Mamba · mradermacher
Params2.77B
Context1024K
Q4_K_M1.6 GB
GE
Gemma 4 26B A4B It DFlash
Gemma · Anbeeld
Params430M
Context256K
Q4_K_M0.3 GB
GE
gemma 1.1 2b it GGUF smashed
Gemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
gemma 3 270m it
Gemma · Open4bits
Params268M
Context32K
Q4_K_M0.3 GB
SM
SmolLM2 360M Instruct heretic
SmolLM · saidutta69
Params362M
Context8K
Q4_K_M0.3 GB
GE
Gemma 3 270m
Gemma · ggml-org
Params268M
Context32K
Smallest0.3 GB
MI
MiniCPM V 4.7 1B
MiniCPM · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
LL
Llama3Ternary 2b
Llama · CMSManhattan
Params2.1B
Context8K
Q4_K_M1.3 GB
QW
Qwen3 0.6B
Qwen · NANI-Nithin
Params752M
Context40K
Q4_K_M0.5 GB
TE
Ternary-Bonsai-2-27B-DFlash2-ft5
Ternary · Schiltmans
Params1.92B
Context256K
Q4_K_M1.1 GB
GE
Gemma 4 E2B It Dspark
Gemma · rasyosef
Params262M
Context128K
Smallest0.3 GB
MO
moss tts local v1.5
Moss · cstr
Params2.12B
Context—
Smallest2.1 GB
HO
Holo 3.1 0.8B
Holo · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
BE
Beck 1.7B
Beck · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
SA
Sarvam 1
Sarvam · bartowski
Params2.53B
Context8K
Q4_K_M1.5 GB