Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
GPT 5 Distill llama3.2 3B Instruct Heretic
Llama · ChiKoi7
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
CO
Yi Coder 1.5B Chat
Coder · second-state
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
NI
NinjaMouse 3B 40L Danube
Ninjamouse · mradermacher
Params2.94B
Context16K
Q4_K_M1.8 GB
Coding
LL
AMD Llama 135m i1
Llama · mradermacher
Params134M
Context2K
Q4_K_M0.1 GB
GGUF
QW
raspberry 3B
Qwen · QuantFactory
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
Lattice 7 Hermes CDM Poincare Instruct
Qwen · DuoNeural
Params437M
Context512
Smallest0.4 GB
GGUF
GE
gemma 2 2b LoRA MonsterInstruct
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen2.5 3B Instruct Abliterated
Qwen · Bluerosesbutterfly
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
OL
AMD OLMo 1B SFT
OLMo · bartowski
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved NVFP4 Experts Only
Qwen · llmfan46
Params447M
Context256K
Smallest21.7 GB
Vision
QW
Qwen3 Shining Lucy CODER 2.4B E32 Mix2
Qwen · mradermacher
Params2.43B
Context40K
Q4_K_M1.5 GB
CodingReasoningTool use
LI
Lightning 1.7B
Lightning · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
Tool use
QW
Qwen3.5 2B Uncensored Zero Refusal SOMA
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningRoleplayTool use
QW
Qwen3-0.6B-abliterated
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
NA
nanochat-40M
Nanochat · hudsongouge
Params40M
Context1K
Q4_K_M0.0 GB
GGUF
QW
Vivy R Vision 3B
Qwen · vinguyen0891
Params3.4B
Context32K
Q4_K_M2.1 GB
Tool useVision
QW
hk cantonese cc0 qwen3 tts
Qwen · jmtl
Params1.92B
Context—
Smallest0.3 GB
GGUF
QW
Qwen2 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
SE
SEX ROLEPLAY V3 3.2 1B i1
Sex · Shadow9564
Params1.5B
Context128K
Q4_K_M1.0 GB
CodingReasoningRoleplay
IN
InstructLM 1.3B
Instructlm · QuantFactory
Params1.35B
Context2K
Q4_K_M0.8 GB
GGUF
SM
SmolVLM2 256M Video Instruct
Smolvlm · mradermacher
Params163M
Context8K
Q4_K_M0.1 GB
Vision
MI
MiniChat 1.5 3B
Minichat · tsunemoto
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
LF
LFM2 1.2B Tool
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
LF
LFM 2.6B Claude4.8 GPT 5.6 Sol Grok 4.6_Fable5 Distilled
Lfm · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
ReasoningTool use
AI
aigc rewriter
Aigc · skskk
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen3.5 9B MTP SWE Agent
Qwen · raicoon2k
Params456M
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
OM
d1-omni-600M
Omni · AtomicChat
Params381M
Context125K
Q4_K_M0.3 GB
Vision
MI
Sakura MiniCPM V 4.7 1B
MiniCPM · webmp3
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool useVision
QW
Gliese Qwen3.5 0.8B Abliterated Caption
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
ReasoningTool useVision
YO
Youtu LLM 2B
Youtu · AaryanK
Params1.96B
Context128K
Q4_K_M1.2 GB
CodingReasoningTool use

Other sizes

Keep browsing