Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
OV
OvisOCR3
Ovisocr · michalland
Params752M
Context256K
Smallest0.8 GB
ReasoningTool useVision
QW
Qwen2.5 0.5B Instruct uncensored
Qwen · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
GGUF
EM
Embeddinggemma 2
Embeddinggemma · BennyDaBall
Params271M
Context256K
Smallest0.2 GB
EmbeddingVision
MU
Muse Glimmer 30B DFlash
Muse · magnitudedev
Params2.56B
Context128K
Smallest1.6 GB
ReasoningTool use
QW
s1-mini
Qwen · Mungert
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
GR
granite-3b-code-instruct
Granite · SanctumAI
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
SU
SupraTitle 50M
Supra · SupraLabs
Params52M
Context5K
Q4_K_M0.0 GB
GGUF
GE
gemma 4 E4B it qat MTP
Gemma · magnitudedev
Params78M
Context128K
Smallest0.1 GB
ReasoningTool use
GE
Gemma 3 1b Pt
Gemma · gguf-org
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
SM
SmolVLM2 500M Video Instruct
Smolvlm · second-state
Params409M
Context8K
Q4_K_M0.3 GB
Vision
ST
Kyutai-STT
Stt · cstr
Params1.05B
Context—
Smallest0.7 GB
GGUF
GO
goppa ai Goppa LogiLlama
Goppa · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
MO
Morrow 2.6B
Morrow · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
GGUF
NE
nexus science
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LF
LFM2.5 8B A1B DSpark Draft v1
Lfm · magnitudedev
Params328M
Context125K
Smallest0.4 GB
ReasoningTool use
MA
Mamba 2.8b Hf
Mamba · mradermacher
Params2.77B
Context1024K
Q4_K_M1.6 GB
GGUF
GE
Gemma 4 26B A4B It DFlash
Gemma · Anbeeld
Params430M
Context256K
Q4_K_M0.3 GB
GGUF
GE
gemma 1.1 2b it GGUF smashed
Gemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 3 270m it
Gemma · Open4bits
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M Instruct heretic
SmolLM · saidutta69
Params362M
Context8K
Q4_K_M0.3 GB
Roleplay
GE
Gemma 3 270m
Gemma · ggml-org
Params268M
Context32K
Smallest0.3 GB
GGUF
MI
MiniCPM V 4.7 1B
MiniCPM · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
LL
Llama3Ternary 2b
Llama · CMSManhattan
Params2.1B
Context8K
Q4_K_M1.3 GB
Tool use
QW
Qwen3 0.6B
Qwen · NANI-Nithin
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
TE
Ternary-Bonsai-2-27B-DFlash2-ft5
Ternary · Schiltmans
Params1.92B
Context256K
Q4_K_M1.1 GB
GGUF
GE
Gemma 4 E2B It Dspark
Gemma · rasyosef
Params262M
Context128K
Smallest0.3 GB
ReasoningTool use
MO
moss tts local v1.5
Moss · cstr
Params2.12B
Context—
Smallest2.1 GB
GGUF
HO
Holo 3.1 0.8B
Holo · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool useVision
BE
Beck 1.7B
Beck · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
SA
Sarvam 1
Sarvam · bartowski
Params2.53B
Context8K
Q4_K_M1.5 GB
Tool use

Other sizes

Keep browsing