Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
BG
bge m3 Q8 0
BGE · ggml-org
Params567M
Context8K
Smallest0.6 GB
NE
Nemotron Speech Streaming EN
Nemotron · handy-computer
Params618M
Context—
Q4_K_M0.5 GB
LF
LFM3 Audio 2B
Lfm · LiquidAI
Params1.73B
Context125K
Q4_K_M1.1 GB
ST
stable diffusion 3.5 medium
Stable · second-state
Params695M
Context—
Smallest0.1 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
IN
Index Translate 2B
Index · IndexTeam
Params1.94B
Context256K
Q4_K_M1.3 GB
MI
MiniCPM V 4.7 35B A3B DSpark
MiniCPM · openbmb
Params389M
Context256K
Q4_K_M0.2 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B 24GB LiLiCorr
Nemotron · nvidia
Params1.11B
Context256K
Smallest1.0 GB
QW
DFlash
Qwen · Alittlehammmer
Params1.73B
Context256K
Q4_K_M1.0 GB
PA
Parakeet CTC 0.6B
Parakeet · handy-computer
Params609M
Context—
Q4_K_M0.5 GB
QW
Qwopus3.5 9B Coder MTP
Qwopus · Jackrong
Params456M
Context256K
Q4_K_M5.8 GB
GE
Gemma 3 1B It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · Andycurrent
Params1B
Context32K
Q4_K_M0.8 GB
QW
Qwen3 0.6B Heretic Abliterated Uncensored
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3 0.6B Heretic Heresy Edition
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
SM
SmolLM2 360M Instruct
SmolLM · bartowski
Params362M
Context8K
Q4_K_M0.3 GB
TI
Tinylaya For Testing
Tinylaya · ggml-org
Params90M
Context8K
Smallest0.1 GB
SM
SmolVLM2 500M Video Instruct
Smolvlm · ggml-org
Params409M
Context8K
Smallest0.4 GB
SM
SmolVLM 256M Instruct
Smolvlm · ggml-org
Params163M
Context8K
Smallest0.2 GB
LF
Lfm2.5-Vl-3B
Lfm · unsloth
Params2.7B
Context125K
Q4_K_M1.7 GB
FU
Fun-ASR Nano
Fun · handy-computer
Params830M
Context—
Q4_K_M0.6 GB
MI
Ministral 3 3B Instruct 2512
Mistral · bartowski
Params3.43B
Context256K
Q4_K_M2.1 GB
IM
z image
Image · gguf-org
Params84M
Context—
Q4_K_M4.5 GB
QW
qwen3-tts-tokenizer-12hz
Qwen · cstr
Params162M
Context—
Smallest0.3 GB
QW
Qwen3.8 27B ZeroRefusal UD IQ4 XS MTP
Qwen · QQZ2026
Params461M
Context—
Smallest0.0 GB
QW
Qwen3 0.6B Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3 0.6B Heretic Abliterated Uncensored
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3 0.6B Heretic
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
VI
VieNeu TTS v2
Vieneu · pnnbao-ump
Params294M
Context4K
Smallest0.2 GB
SM
SmolLM2 360M Instruct
SmolLM · HuggingFaceTB
Params362M
Context8K
Smallest0.4 GB
TU
SD Turbo
Turbo · Green-Sky
Params1.3B
Context—
Smallest2.0 GB