Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8-27B-DFlash2
Qwen · z-lab
Params1.92B
Context256K
Q4_K_M1.1 GB
GGUF
QW
Ternary-Bonsai-2-9B-DFlash2
Qwen · prism-ml
Params2.5B
Context256K
Smallest1.6 GB
Vision
GE
gemma-4-26B-A4B-it
Gemma · ggml-org
Params450M
Context256K
Smallest0.3 GB
Vision
QW
qwen2.5-0.5b-instruct
Qwen · Qwen
Params630M
Context32K
Q4_K_M0.5 GB
GGUF
BR
Breeze-TTS-2
Breeze · HoppouAI
Params3.01B
Context—
Smallest2.5 GB
GGUF
CA
Canary 180M Flash
Canary · handy-computer
Params189M
Context—
Q4_K_M0.1 GB
GGUF
LF
LFM2.5 Audio 1.5B JP
Lfm · LiquidAI
Params190M
Context125K
Smallest0.0 GB
Vision
HY
Hy MT2 1.8B
tencent
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
LF
LFM2.5 1.2B Instruct
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
LF
LFM2.5 230M
Lfm · LiquidAI
Params230M
Context125K
Q4_K_M0.2 GB
GGUF
MI
MiniCPM5 2B
MiniCPM · openbmb
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingTool use
AU
AuK Base and Flash
Auk · audio-cpp
Params1.53B
Context—
Smallest0.6 GB
GGUF
LF
LFM2.5 Audio 1.5B
Lfm · LiquidAI
Params190M
Context125K
Smallest0.1 GB
Vision
QW
Qwen3.5-0.8B
Qwen · unsloth
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Ternary-Bonsai-2-2B
Qwen · prism-ml
Params1.88B
Context256K
Smallest0.4 GB
Vision
GP
gpt-oss-20b
gpt-oss · ggml-org
Params870M
Context128K
Smallest0.9 GB
GGUF
GE
Gemma 3 1b It
Gemma · ggml-org
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
SM
TwIL LM3
SmolLM · webAI-Official
Params3.08B
Context64K
Q4_K_M1.9 GB
Reasoning
QW
Qwen3-ASR 1.7B
Qwen · handy-computer
Params2.04B
Context—
Q4_K_M1.3 GB
GGUF
GP
gpt-oss-120b
gpt-oss · ggml-org
Params800M
Context128K
Smallest0.8 GB
GGUF
QW
qwen2.5-3b-instruct
Qwen · Qwen
Params3.4B
Context32K
Q4_K_M2.1 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct GGUF
Qwen · Qwen
Params1.78B
Context32K
Q4_K_M1.1 GB
Coding
MI
s1 mini
Mini · superwhisper
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
SP
Spark X2.5 1.7B
Spark · XHToken
Params1.71B
Context1024K
Q4_K_M1.1 GB
GGUF
QW
Qwen3-1.7B
Qwen · unsloth
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
QW
Qwen3 0.6B Instruct
Qwen · Qwen
Params596M
Context40K
Smallest0.6 GB
GGUF
GE
gemma 4 12B it qat
Gemma · unsloth
Params440M
Context256K
Smallest0.3 GB
Vision
MI
MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking
MiniCPM · GnLOLot
Params1.08B
Context128K
Smallest1.2 GB
ReasoningTool use
BG
bge small en v1.5
BGE · unsloth
Params33M
Context512
Smallest0.1 GB
Embedding
MX
mxbai-embed-large-v1
Mxbai · ChristianAzinn
Params334M
Context512
Q4_K_M0.2 GB
Embedding

Other sizes

Keep browsing