Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
GPT2-774M-CINDER-SHOW-MULTI-CHAT
Gpt · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
MO
moonshine-tiny
Moonshine · cstr
Params27M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3-Vl-2B-Instruct-1M
Qwen · unsloth
Params1.72B
Context977K
Q4_K_M1.1 GB
Vision
DE
DeepCoder 1.5B Preview
Deepcoder · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
MA
Maincoder 1B
Maincoder · mradermacher
Params1.03B
Context2K
Q4_K_M0.7 GB
Coding
ST
stable diffusion xl base 1.0
Stable · kostakoff
Params3.47B
Context—
Smallest2.7 GB
GGUF
QW
Qwen3.8 27B DFlash2
Qwen · Anbeeld
Params1.92B
Context256K
Q4_K_M1.1 GB
GGUF
YU
Yue2-3B-GGUF
Yue · tungnguyen84
Params677M
Context—
Smallest0.3 GB
GGUF
TI
py007_tinyllama-1.1b-intermediate-step-480k-1t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
QW
Qwen2.5 Coder 1.5B Shellsmith
Qwen · ajayk007
Params1.54B
Context32K
Smallest3.1 GB
Coding
LF
Lfm2.5-1.2B-Thinking
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
Reasoning
ON
OneJev 0.8B
Onejev · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
MI
MiniCPM5-2B
MiniCPM · Mungert
Params2.52B
Context128K
Q4_K_M1.7 GB
CodingTool use
CH
Chatterbox Multilingual TTS
Chatterbox · BricksDisplay
Params506M
Context—
Q4_K_M0.2 GB
GGUF
QW
Qwen3.5-2B
Qwen · trubisky
Params1.88B
Context256K
Smallest0.7 GB
GGUF
AR
arco reasoner i1
Arco · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
GE
Gemma 3 270m It
Gemma · gguf-org
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
LL
Impish_LLAMA_3B
Llama · l3utterfly
Params3.2B
Context128K
Q4_K_M2.0 GB
GGUF
ST
stable diffusion v2 1
Stable · gpustack
Params1.29B
Context—
Smallest2.2 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
SM
SmolLlamix 8x101M take2
Smolllamix · mradermacher
Params399M
Context32K
Q4_K_M0.3 GB
GGUF
QW
Qwen2.5 VL 3B uncensored bughunter v9
Qwen · mmp2055
Params3.1B
Context125K
Q4_K_M1.9 GB
Tool useVision
WH
Whisper Tiny (English)
Whisper · handy-computer
Params38M
Context—
Q4_K_M0.0 GB
GGUF
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
QW
Qwen3.6 35B A3B DFlash
Qwen · Anbeeld
Params386M
Context256K
Q4_K_M0.2 GB
CodingEmbedding
OR
Ornith 1.0 9B heretic MTP
Ornith · SC117
Params456M
Context256K
Q4_K_M5.8 GB
ReasoningVision
LL
shisa v2.1 llama3.2 3b
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
GR
Huihui Granite 4.1 3b Abliterated
Granite · huihui-ai
Params3.4B
Context128K
Smallest6.8 GB
GGUF
ZR
ZR1 1.5B
bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
QW
ISO27001 Qwen2.5 0.5B Edge
Qwen · sallani
Params494M
Context32K
Q4_K_M0.4 GB
GGUF

Other sizes

Keep browsing