Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiniCPM OCR 1.0
MiniCPM · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
LF
LFM2-2.6B-Transcript
Lfm · Mungert
Params2.57B
Context125K
Q4_K_M1.6 GB
Tool use
MI
SuperMiniCPM5 2B Qween
MiniCPM · bunnycore
Params2.52B
Context128K
Smallest2.7 GB
ReasoningTool use
KV
KviGPT 7b Chat i1
Kvigpt · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated IQ3 S Q8PLE
Qwen · dan9070
Params603M
Context256K
Smallest0.7 GB
ReasoningTool useVision
IN
Internlm2_5 1_8b Chat
InternLM · gaianet
Params1.89B
Context32K
Q4_K_M1.2 GB
Coding
MI
MiniCPM5 2B Heretic Abliterated
MiniCPM · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingReasoningTool use
QW
Qwen2.5 1.5B Instruct
Qwen · enacimie
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
QW
Qwen2.5 Math 1.5B
Qwen · mradermacher
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
QW
Qwen3 0.6B
Qwen · second-state
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
QW
hishab qwen3.5 0.8b json full v10
Qwen · ryuma007
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
ZE
Zedev-134M
Zedev · Meridian-MRM
Params134M
Context1K
Smallest0.3 GB
Tool use
QW
Entry_Coder_05_V3_256K_Merged
Qwen · Secondchancee
Params494M
Context256K
Q4_K_M0.4 GB
CodingTool use
QW
Huihui ai.Qwen2.5 3B Instruct Abliterated SFT
Qwen · DevQuasar-13
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MI
MiLMMT 46 1B v1.0
Milmmt · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
AU
Ze1.5 Automotive Embedded Instruct
Automotive · anyze
Params1.54B
Context128K
Smallest3.1 GB
EmbeddingTool use
QW
Qwen3.5 Uncensored
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
SP
SpaceOm
Spaceom · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
ReasoningVision
QW
Rice Cracker Qwen3.5 0.8B Abliterated Base
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
CodingReasoningTool use
QW
Qwen3 VL 2B Instruct Abliterated
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
Tool useVision
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · ThomasBaruzier
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
JI
jina embeddings v5 omni small classification
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
MI
minicpm5 1B GLM 5.2 Agentic v7
MiniCPM · hudsongouge
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
GE
Gemma 2 2b All in One
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SM
SmolVLM2 2.2B Instruct
Smolvlm · mradermacher
Params1.81B
Context8K
Q4_K_M1.1 GB
Vision
NO
Nora0.1 1.7B
Nora · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningRoleplayTool use
SI
silero lid lang95
Silero · cstr
Params4M
Context—
Smallest0.0 GB
GGUF
SM
SmolLM3 3B Heretic Uncensored
SmolLM · virtualdmns
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use

Other sizes

Keep browsing