Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
SE
SEX ROLEPLAY 3.2 1B i1
Sex · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
LF
LFM2.5 1.2B JP
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
NE
Next 1b
Next · mattritchey
Params1B
Context32K
Q4_K_M0.8 GB
DE
Deepseek Coder 1.3b Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
MI
Ministral 3 3B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
VO
VoxCPM-0.5B
Voxcpm · bluryar
Params728M
Context32K
Smallest0.5 GB
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
snap1 2B
MiniCPM · logitlab
Params2.52B
Context128K
Q4_K_M1.6 GB
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
LI
LightOnOCR 2 1B
Lightonocr · noctrex
Params596M
Context16K
Q4_K_M0.4 GB
LI
LightOnOCR 2 1B Ocr Soup
Lightonocr · noctrex
Params596M
Context16K
Q4_K_M0.4 GB
ME
meta flores translation chinese english model
Meta · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
PA
Paraformer-zh
Paraformer · cstr
Params220M
Context—
Smallest0.1 GB
NE
NeuralAI Nae1
Neuralai · Subject-Emu-5259
Params125M
Context2K
Q4_K_M0.1 GB
KI
Kisoku 1.6b
Kisoku · mradermacher
Params1.6B
Context128K
Q4_K_M1.0 GB
QW
Huihui Qwen3 VL 2B Instruct Abliterated
Qwen · noctrex
Params1.72B
Context256K
Q4_K_M1.1 GB
LF
LFM2 1.2B RAG
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
MI
Ministral 3 3B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · ThomasBaruzier
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen3.8 27B TURBO Fable ColdFusion 735 882 Heretic Uncensored NEO CODER MAX MTP NVFP4 Q8 Q3
Qwen · AIconjured
Params461M
Context256K
Smallest13.9 GB
RW
rwkv 6 world 1b6
Rwkv · latestissue
Params1.6B
Context1024K
Smallest0.7 GB
QW
Qwen3.5 9B DFlash
Qwen · magnitudedev
Params1.29B
Context40K
Smallest1.4 GB
MI
Voxtral-Mini-4B-Realtime-2602
Mistral · ggml-org
Params3.43B
Context128K
Q4_K_M2.6 GB
NS
NSFW 3B
Nsfw · QuantFactory
Params2.8B
Context4K
Q4_K_M1.7 GB
TI
TinyLlama-1.1B-DavidAttenborough
Tinyllama · mradermacher
Params1.1B
Context4K
Q4_K_M0.7 GB
MI
Huihui MiniCPM V 4.6 Thinking Abliterated
MiniCPM · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen2 VL 2B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
AN
Anime Girl 1.5B
Anime · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
FA
Falcon-H1-0.5B-Instruct
Falcon · unsloth
Params521M
Context16K
Q4_K_M0.3 GB
SM
SmolVLM2 2.2B Instruct Agentic GUI
Smolvlm · bartowski
Params1.81B
Context8K
Q4_K_M1.1 GB