Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Vikhr-Qwen-2.5-1.5B-Instruct
Qwen · QuantFactory
Params1.78B
Context32K
Q4_K_M1.1 GB
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · cstr
Params638M
Context—
Smallest0.4 GB
PH
Phi 1.5 Tele
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
BI
bitnet persian r10
Bitnet · smhsmh
Params2.41B
Context4K
Smallest1.2 GB
SM
Smollm3 3b German Embed
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
GR
Models Ibm Granite Granite 3.0 2b Instruct
Granite · MaziyarPanahi
Params2.63B
Context4K
Q4_K_M1.6 GB
SI
Simllama 1.1 Instruct
Simllama · mradermacher
Params468M
Context4K
Q4_K_M0.3 GB
QW
qwen2.5 0.5b resume parser
Qwen · thrinath25
Params494M
Context32K
Q4_K_M0.4 GB
GE
Bangla Gpt Pro
Gemma · mradermacher
Params773M
Context256K
Q4_K_M0.5 GB
QW
Huihui ai.Qwen2.5 1.5B Instruct Abliterated SFT
Qwen · DevQuasar-14
Params1.54B
Context32K
Q4_K_M1.0 GB
TI
TinyLlama 1.1B python v0.1
Tinyllama · TinyLlama
Params1.1B
Context2K
Smallest0.6 GB
QW
Qwen3 1.7B Multilingual TTS
Qwen · mradermacher
Params1.85B
Context32K
Q4_K_M1.2 GB
QW
Qwen2 1.5B Ita
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2 VL 2B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2.5 0.5B
Qwen · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
QW
CapRL Qwen3VL 2B
Qwen · prithivMLmods
Params2.03B
Context256K
Q4_K_M1.3 GB
SP
Spark X2.5 1.7B Abliterated
Spark · darioooooo0o
Params1.98B
Context1024K
Q4_K_M1.3 GB
QW
Vivy R Robotics 3B
Qwen · vinguyen0891
Params3.4B
Context32K
Q4_K_M2.1 GB
OP
Oprius 3.1 1.1B
Oprius · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
DE
DeepScaleR 1.5B Preview
Deepscaler · DevQuasar-12
Params1.78B
Context128K
Q4_K_M1.1 GB
CY
CyberRealistic Pony
Cyberrealistic · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
SM
SmolLM2 1.7B
SmolLM · duyntnet
Params1.71B
Context8K
Q4_K_M1.1 GB
LF
LFM3 1.7B Claude Code
Lfm · mondk
Params1.73B
Context256K
Smallest1.8 GB
MI
MiniCPM5 2B Elffuss Code
MiniCPM · UtopiaIA
Params2.52B
Context128K
Smallest3.2 GB
QW
mumble cleanup 2stage
Qwen · trevornk
Params494M
Context32K
Smallest0.4 GB
QW
Qwen3 0.6B tg signal extract
Qwen · Sigrex
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen2.5 3B Instruct
Qwen · zw89
Params3.09B
Context32K
Q4_K_M1.9 GB
LF
LFM2 Audio 1.5B
Lfm · LiquidAI
Params281M
Context—
Smallest0.4 GB
QU
quartz micro preview v2
Quartz · VertexAGI
Params100M
Context1K
Q4_K_M0.1 GB
KR
Kromoss
Kromoss · molbal
Params3.5B
Context—
Q4_K_M3.6 GB