Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 06B 3MPER0RR Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
LL
llama3.2 1b 2025 uncensored v2
Llama · carsenk
Params1.24B
Context128K
Smallest1.3 GB
CodingReasoning
BE
Beat This! (final0)
Beat · cstr
Params20M
Context—
Smallest0.0 GB
GGUF
LI
LightOnOCR 2 1B
Lightonocr · wangjazz
Params596M
Context16K
Q4_K_M0.4 GB
Vision
QW
Qwen3 0.6B Uncensored
Qwen · Null-Guard
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
PH
Phi 2 OmniMatrix
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · ahmed-amedo
Params1.86B
Context—
Smallest0.9 GB
GGUF
QW
Zero To CAD Qwen3 VL 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
CodingTool useVision
QW
Qwen2.5 0.5B Instruct Abliterated
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
TA
Tacit 1.7B
Tacit · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
GE
Gemma 2b It
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
Mini-Omni2
Mini · cstr
Params782M
Context—
Smallest1.1 GB
GGUF
SM
SmolVLM2 2.2B Instruct
Smolvlm · second-state
Params1.81B
Context8K
Q4_K_M1.1 GB
Vision
QW
Qwen2.5 1.5B Instruct Abliterated
Qwen · Vali
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
JI
jina embeddings v5 omni small retrieval
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingVision
DI
DialoGPT MedDialog large
Dialogpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
PY
Pythia 1b Deduped
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
JI
Jina Reranker v2 Base Multilingual
Jina · gpustack
Params278M
Context1K
Q4_K_M0.2 GB
CodingEmbedding
GP
GPT OSS 20B P EAGLE
gpt-oss · TULLUS
Params1.8B
Context128K
Q4_K_M1.5 GB
GGUF
QW
Qwen3 ASR
Qwen · Jaffe2718
Params938M
Context—
Smallest0.9 GB
GGUF
MI
MiniMA-2-1B
Minima · mradermacher
Params1.37B
Context4K
Q4_K_M0.8 GB
GGUF
QW
reasoning summarizer qwen3.5 0.8b preview
Qwen · mithulaartigala
Params752M
Context256K
Q4_K_M0.5 GB
Reasoning
LL
Llama 3.2 1B Instruct
Llama · ThomasBaruzier
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
SM
Smart Commit 1.5b v0.3
Smart · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
KL
Klyrune 2B Coder
Klyrune · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingReasoningTool use
SI
SIREN 3B
Siren · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
SM
SmolLM 360M
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
Tool use
CO
cohere asr ja
Cohere · CKHO
Params2.07B
Context—
Smallest1.5 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct heretic
Qwen · saidutta69
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingRoleplayTool use

Other sizes

Keep browsing