Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Qwen2.5 Coder 1.5B Unsensored DPO
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
OM
OmniASR-LLM-300M
Omniasr · cstr
Params1.63B
Context—
Smallest1.1 GB
RW
rwkv7 g1h 2.9b i1
Rwkv · RemySkye
Params2.95B
Context1024K
Q4_K_M2.1 GB
LF
LFM2.5 230M
Lfm · mradermacher
Params230M
Context125K
Q4_K_M0.2 GB
LL
Deep Reasoning Llama 3.2 Dolphin3.0 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
Llm Jp 3 1.8b
Llm · mmnga
Params1.87B
Context4K
Q4_K_M1.2 GB
QW
Qwen 2.5 3b RP i1
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M2.1 GB
LL
MiniThinky v2 1B Llama 3.2
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
AR
arco reflection v4
Arco · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
MI
midjourney prompt improver lora model
Midjourney · jzdesign
Params3.21B
Context128K
Q4_K_M2.0 GB
DA
danube2-1.8b-Neural
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
PA
parakeet tdt 1.1b
Parakeet · cstr
Params1.07B
Context—
Smallest0.7 GB
LF
LFM2.5 VL 3B
Lfm · bartowski
Params2.7B
Context125K
Q4_K_M1.7 GB
QW
Qwen 2.5 3b Decensored
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
SM
SmolLM 135M Taiwan Instruct v1.0
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
FI
v6 Finch 3B HF
Finch · bartowski
Params3.1B
Context1024K
Q4_K_M1.9 GB
QW
Huihui Qwen3 VL 2B Thinking Abliterated
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
NE
NeuTTS Air
Neutts · BricksDisplay
Params262M
Context—
Q4_K_M0.3 GB
EM
xVITA Embed2 zhTW
Embeddinggemma · xCloudinfo
Params271M
Context256K
Q4_K_M0.2 GB
FL
Flux Prompt Enhance
Flux · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
VI
VibeThinker 3B
Vibethinker · prithivMLmods
Params3.09B
Context128K
Q4_K_M1.9 GB
FL
flux dev
Flux · gguf-org
Params123M
Context—
Q4_K_M6.7 GB
QW
ISO42001 Qwen2.5 0.5B Edge
Qwen · sallani
Params494M
Context32K
Smallest1.0 GB
KO
kokoro
Kokoro · mmwillet2
Params88M
Context—
Smallest0.2 GB
CO
codegemma-2b
Codegemma · bartowski
Params2.51B
Context8K
Q4_K_M1.6 GB
DO
dopeystableplats 3b v1
Dopeystableplats · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
YZ
yzma tests
Yzma · deadprogram
Params19M
Context8K
Smallest0.0 GB
TI
TinySlime-1.1B-Chat-v1.0
Tinyslime · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
LF
LFM2.5 1.2B Instruct heretic
Lfm · saidutta69
Params1.17B
Context125K
Q4_K_M0.7 GB