Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
DE
DeepSeek R1 Distill Qwen 1.5B OBLITERATED
DeepSeek · ArRENCEAI
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen2 VL OCR 2B Instruct
Qwen · prithivMLmods
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama 3.1 8B ascii cats
Llama · Needless64
Params3.2B
Context128K
Smallest3.4 GB
BG
bge m3
BGE · vonjack
Params567M
Context8K
Smallest0.6 GB
LL
AMD Llama 135m code i1
Llama · mradermacher
Params134M
Context2K
Q4_K_M0.1 GB
QW
Omega Qwen2.5 Coder 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
LF
Lfm2.5 2.6b Fable5 Coding Agent Heretic
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
SA
Salamandra 2b Instruct
Salamandra · mradermacher
Params2.25B
Context8K
Q4_K_M1.5 GB
QW
Qwen2.5 0.5B Instruct Abliterated SFT
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
RI
RIFA CODE 0.6B
Rifa · smshahbaj
Params596M
Context40K
Q4_K_M0.4 GB
IN
Internvl3-2B-Instruct
Internvl · unsloth
Params1.78B
Context32K
Q4_K_M1.1 GB
LF
lfm3 omni vl 2b 1rco 2mix
Lfm · efeisot
Params1.73B
Context125K
Smallest0.0 GB
SM
SmolLM 1.7B
SmolLM · MaziyarPanahi
Params1.71B
Context2K
Q4_K_M1.1 GB
CA
Carrot-Ko-2.1B-Instruct
Carrot · mradermacher
Params2.34B
Context32K
Q4_K_M1.5 GB
MI
MiniCPM V 4.7 1B
MiniCPM · theokiGuyOKI
Params1.01B
Context256K
Q4_K_M0.7 GB
IN
Internvl3-1B
Internvl · unsloth
Params630M
Context32K
Q4_K_M0.5 GB
QW
BitCache Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
HE
Hy MT2 1.8B Heretic
Heretic · mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
MO
Moonshine Base (Ukrainian)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
IR
irodori tts voicedesign
Irodori · cstr
Params71M
Context—
Smallest0.1 GB
OV
OvisOCR3
Ovisocr · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
SP
Spark X2.5 1.7B
Spark · ngquocvinh
Params1.71B
Context1024K
Q4_K_M1.1 GB
LF
LFM2.5 ColBERT 350M
Lfm · LiquidAI
Params353M
Context125K
Q4_K_M0.2 GB
MO
Moonshine Base (Japanese)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
QW
lb reranker 0.5B v1.0
Qwen · QuantFactory
Params630M
Context32K
Q4_K_M0.5 GB
QW
connectailab rl CHOCO BRAIN GUARD v1
Qwen · hwihwalab
Params752M
Context256K
Smallest0.8 GB
QW
Qwen2 VL 2B Instruct
Qwen · turingevo
Params1.54B
Context32K
Q4_K_M1.0 GB
SU
Supra 50M Instruct
Supra · SupraLabs
Params52M
Context1K
Smallest0.1 GB
BE
Beck 0.6B
Beck · bartowski
Params596M
Context40K
Q4_K_M0.4 GB