Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
SE
SEX ROLEPLAY 3.2 1B i1
Sex · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Roleplay
LF
LFM2.5 1.2B JP
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
NE
Next 1b
Next · mattritchey
Params1B
Context32K
Q4_K_M0.8 GB
Coding
DE
Deepseek Coder 1.3b Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
MI
Ministral 3 3B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Reasoning
VO
VoxCPM-0.5B
Voxcpm · bluryar
Params728M
Context32K
Smallest0.5 GB
GGUF
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MI
snap1 2B
MiniCPM · logitlab
Params2.52B
Context128K
Q4_K_M1.6 GB
GGUF
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
LI
LightOnOCR 2 1B
Lightonocr · noctrex
Params596M
Context16K
Q4_K_M0.4 GB
Vision
LI
LightOnOCR 2 1B Ocr Soup
Lightonocr · noctrex
Params596M
Context16K
Q4_K_M0.4 GB
Vision
ME
meta flores translation chinese english model
Meta · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
GGUF
PA
Paraformer-zh
Paraformer · cstr
Params220M
Context—
Smallest0.1 GB
GGUF
NE
NeuralAI Nae1
Neuralai · Subject-Emu-5259
Params125M
Context2K
Q4_K_M0.1 GB
Tool use
KI
Kisoku 1.6b
Kisoku · mradermacher
Params1.6B
Context128K
Q4_K_M1.0 GB
Coding
QW
Huihui Qwen3 VL 2B Instruct Abliterated
Qwen · noctrex
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
LF
LFM2 1.2B RAG
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
MI
Ministral 3 3B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Reasoning
QW
Qwen2.5 Coder 3B Instruct
Qwen · ThomasBaruzier
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
QW
Qwen3.8 27B TURBO Fable ColdFusion 735 882 Heretic Uncensored NEO CODER MAX MTP NVFP4 Q8 Q3
Qwen · AIconjured
Params461M
Context256K
Smallest13.9 GB
CodingVision
RW
rwkv 6 world 1b6
Rwkv · latestissue
Params1.6B
Context1024K
Smallest0.7 GB
GGUF
QW
Qwen3.5 9B DFlash
Qwen · magnitudedev
Params1.29B
Context40K
Smallest1.4 GB
GGUF
MI
Voxtral-Mini-4B-Realtime-2602
Mistral · ggml-org
Params3.43B
Context128K
Q4_K_M2.6 GB
Vision
NS
NSFW 3B
Nsfw · QuantFactory
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
TI
TinyLlama-1.1B-DavidAttenborough
Tinyllama · mradermacher
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
MI
Huihui MiniCPM V 4.6 Thinking Abliterated
MiniCPM · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningVision
QW
Qwen2 VL 2B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
AN
Anime Girl 1.5B
Anime · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
FA
Falcon-H1-0.5B-Instruct
Falcon · unsloth
Params521M
Context16K
Q4_K_M0.3 GB
GGUF
SM
SmolVLM2 2.2B Instruct Agentic GUI
Smolvlm · bartowski
Params1.81B
Context8K
Q4_K_M1.1 GB
Vision

Other sizes

Keep browsing