Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 1.5B OBLITERATED
DeepSeek · ArRENCEAI
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen2 VL OCR 2B Instruct
Qwen · prithivMLmods
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingVision
LL
Llama 3.1 8B ascii cats
Llama · Needless64
Params3.2B
Context128K
Smallest3.4 GB
GGUF
BG
bge m3
BGE · vonjack
Params567M
Context8K
Smallest0.6 GB
Embedding
LL
AMD Llama 135m code i1
Llama · mradermacher
Params134M
Context2K
Q4_K_M0.1 GB
Coding
QW
Omega Qwen2.5 Coder 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingReasoningTool use
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
LF
Lfm2.5 2.6b Fable5 Coding Agent Heretic
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
Tool use
SA
Salamandra 2b Instruct
Salamandra · mradermacher
Params2.25B
Context8K
Q4_K_M1.5 GB
Coding
QW
Qwen2.5 0.5B Instruct Abliterated SFT
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
RI
RIFA CODE 0.6B
Rifa · smshahbaj
Params596M
Context40K
Q4_K_M0.4 GB
CodingReasoningTool use
IN
Internvl3-2B-Instruct
Internvl · unsloth
Params1.78B
Context32K
Q4_K_M1.1 GB
CodingTool useVision
LF
lfm3 omni vl 2b 1rco 2mix
Lfm · efeisot
Params1.73B
Context125K
Smallest0.0 GB
GGUF
SM
SmolLM 1.7B
SmolLM · MaziyarPanahi
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
CA
Carrot-Ko-2.1B-Instruct
Carrot · mradermacher
Params2.34B
Context32K
Q4_K_M1.5 GB
GGUF
MI
MiniCPM V 4.7 1B
MiniCPM · theokiGuyOKI
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool useVision
IN
Internvl3-1B
Internvl · unsloth
Params630M
Context32K
Q4_K_M0.5 GB
CodingTool useVision
QW
BitCache Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
HE
Hy MT2 1.8B Heretic
Heretic · mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
MO
Moonshine Base (Ukrainian)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
GGUF
IR
irodori tts voicedesign
Irodori · cstr
Params71M
Context—
Smallest0.1 GB
GGUF
OV
OvisOCR3
Ovisocr · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
SP
Spark X2.5 1.7B
Spark · ngquocvinh
Params1.71B
Context1024K
Q4_K_M1.1 GB
GGUF
LF
LFM2.5 ColBERT 350M
Lfm · LiquidAI
Params353M
Context125K
Q4_K_M0.2 GB
EmbeddingTool use
MO
Moonshine Base (Japanese)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
GGUF
QW
lb reranker 0.5B v1.0
Qwen · QuantFactory
Params630M
Context32K
Q4_K_M0.5 GB
EmbeddingTool use
QW
connectailab rl CHOCO BRAIN GUARD v1
Qwen · hwihwalab
Params752M
Context256K
Smallest0.8 GB
ReasoningTool use
QW
Qwen2 VL 2B Instruct
Qwen · turingevo
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
SU
Supra 50M Instruct
Supra · SupraLabs
Params52M
Context1K
Smallest0.1 GB
GGUF
BE
Beck 0.6B
Beck · bartowski
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use

Other sizes

Keep browsing