Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
MI
MiniCPM OCR 1.0
MiniCPM · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
LF
LFM2-2.6B-Transcript
Lfm · Mungert
Params2.57B
Context125K
Q4_K_M1.6 GB
MI
SuperMiniCPM5 2B Qween
MiniCPM · bunnycore
Params2.52B
Context128K
Smallest2.7 GB
KV
KviGPT 7b Chat i1
Kvigpt · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
LL
Llama 3.2 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated IQ3 S Q8PLE
Qwen · dan9070
Params603M
Context256K
Smallest0.7 GB
IN
Internlm2_5 1_8b Chat
InternLM · gaianet
Params1.89B
Context32K
Q4_K_M1.2 GB
MI
MiniCPM5 2B Heretic Abliterated
MiniCPM · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
QW
Qwen2.5 1.5B Instruct
Qwen · enacimie
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2.5 Math 1.5B
Qwen · mradermacher
Params1.54B
Context4K
Q4_K_M1.0 GB
QW
Qwen3 0.6B
Qwen · second-state
Params752M
Context40K
Q4_K_M0.5 GB
QW
hishab qwen3.5 0.8b json full v10
Qwen · ryuma007
Params752M
Context256K
Q4_K_M0.5 GB
ZE
Zedev-134M
Zedev · Meridian-MRM
Params134M
Context1K
Smallest0.3 GB
QW
Entry_Coder_05_V3_256K_Merged
Qwen · Secondchancee
Params494M
Context256K
Q4_K_M0.4 GB
QW
Huihui ai.Qwen2.5 3B Instruct Abliterated SFT
Qwen · DevQuasar-13
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
MiLMMT 46 1B v1.0
Milmmt · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
AU
Ze1.5 Automotive Embedded Instruct
Automotive · anyze
Params1.54B
Context128K
Smallest3.1 GB
QW
Qwen3.5 Uncensored
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
SP
SpaceOm
Spaceom · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
QW
Rice Cracker Qwen3.5 0.8B Abliterated Base
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3 VL 2B Instruct Abliterated
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · ThomasBaruzier
Params494M
Context32K
Q4_K_M0.4 GB
JI
jina embeddings v5 omni small classification
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
MI
minicpm5 1B GLM 5.2 Agentic v7
MiniCPM · hudsongouge
Params1.08B
Context128K
Q4_K_M0.7 GB
GE
Gemma 2 2b All in One
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
SM
SmolVLM2 2.2B Instruct
Smolvlm · mradermacher
Params1.81B
Context8K
Q4_K_M1.1 GB
NO
Nora0.1 1.7B
Nora · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
SI
silero lid lang95
Silero · cstr
Params4M
Context—
Smallest0.0 GB
SM
SmolLM3 3B Heretic Uncensored
SmolLM · virtualdmns
Params3.08B
Context64K
Q4_K_M1.9 GB