Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Qwen3 06B 3MPER0RR Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
LL
llama3.2 1b 2025 uncensored v2
Llama · carsenk
Params1.24B
Context128K
Smallest1.3 GB
BE
Beat This! (final0)
Beat · cstr
Params20M
Context—
Smallest0.0 GB
LI
LightOnOCR 2 1B
Lightonocr · wangjazz
Params596M
Context16K
Q4_K_M0.4 GB
QW
Qwen3 0.6B Uncensored
Qwen · Null-Guard
Params596M
Context40K
Q4_K_M0.4 GB
PH
Phi 2 OmniMatrix
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · ahmed-amedo
Params1.86B
Context—
Smallest0.9 GB
QW
Zero To CAD Qwen3 VL 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen2.5 0.5B Instruct Abliterated
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
TA
Tacit 1.7B
Tacit · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
GE
Gemma 2b It
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
Mini-Omni2
Mini · cstr
Params782M
Context—
Smallest1.1 GB
SM
SmolVLM2 2.2B Instruct
Smolvlm · second-state
Params1.81B
Context8K
Q4_K_M1.1 GB
QW
Qwen2.5 1.5B Instruct Abliterated
Qwen · Vali
Params1.54B
Context32K
Q4_K_M1.0 GB
JI
jina embeddings v5 omni small retrieval
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
DI
DialoGPT MedDialog large
Dialogpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
PY
Pythia 1b Deduped
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
JI
Jina Reranker v2 Base Multilingual
Jina · gpustack
Params278M
Context1K
Q4_K_M0.2 GB
GP
GPT OSS 20B P EAGLE
gpt-oss · TULLUS
Params1.8B
Context128K
Q4_K_M1.5 GB
QW
Qwen3 ASR
Qwen · Jaffe2718
Params938M
Context—
Smallest0.9 GB
MI
MiniMA-2-1B
Minima · mradermacher
Params1.37B
Context4K
Q4_K_M0.8 GB
QW
reasoning summarizer qwen3.5 0.8b preview
Qwen · mithulaartigala
Params752M
Context256K
Q4_K_M0.5 GB
LL
Llama 3.2 1B Instruct
Llama · ThomasBaruzier
Params1.24B
Context128K
Q4_K_M0.8 GB
SM
Smart Commit 1.5b v0.3
Smart · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
KL
Klyrune 2B Coder
Klyrune · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
SI
SIREN 3B
Siren · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
SM
SmolLM 360M
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM 135M Instruct
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
CO
cohere asr ja
Cohere · CKHO
Params2.07B
Context—
Smallest1.5 GB
QW
Qwen2.5 Coder 1.5B Instruct heretic
Qwen · saidutta69
Params1.54B
Context32K
Q4_K_M1.0 GB