Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Qwen 3 VL 2B Instruct Heretic
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
SM
SmolLM 1.7B Instruct
SmolLM · MaziyarPanahi
Params1.71B
Context2K
Q4_K_M1.1 GB
QW
Qwen2.5 1.5B
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
OP
OpenELM 3B
Openelm · RichardErkhov
Params3.04B
Context2K
Q4_K_M1.9 GB
QW
Qwen3.6 35B A3B DSV4Pro Thinking Distill
Qwen · nerkyor
Params447M
Context256K
Q4_K_M21.7 GB
QW
Qwen3 ASR 0.6B
Qwen · mradermacher
Params752M
Context64K
Q4_K_M0.5 GB
QW
Qwen2.5 Coder 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
JI
Jina Embeddings v4 Vllm Retrieval
Jina · mradermacher
Params3.1B
Context125K
Q4_K_M1.9 GB
GR
Granite Embedding 30m English
Granite · bartowski
Params30M
Context512
Q4_K_M0.0 GB
D1
d1 3B
prithivMLmods
Params2.7B
Context32K
Q4_K_M1.7 GB
QW
Ari_Assistant_3B
Qwen · sriyuth
Params3.09B
Context32K
Smallest1.9 GB
LL
Llama 3.1 8B bnb 4bit wenyanwen
Llama · Quentin123
Params3.21B
Context128K
Q4_K_M2.0 GB
EC
EchoSwift 700M
Echoswift · mradermacher
Params742M
Context125K
Q4_K_M0.5 GB
LF
LFM2.5 VL 3B DSpark
Lfm · LiquidAI
Params279M
Context125K
Smallest0.6 GB
OL
OLMo 1B Base shakespeare
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
SP
Spark X2.5 1.7B
Spark · eaddario
Params1.71B
Context—
Smallest0.0 GB
HO
K2-Horizon-0.9B
Horizon · mradermacher
Params1.08B
Context128K
Q4_K_M0.7 GB
HO
K2 Horizon 0.9B Heretic
Horizon · mradermacher
Params1.08B
Context128K
Q4_K_M0.7 GB
IM
Imagine v12
Imagine · Interchained
Params1.35B
Context16K
Q4_K_M0.9 GB
FU
Functiongemma 270m It
Functiongemma · ggml-org
Params268M
Context32K
Smallest0.3 GB
DE
DeepSeek R1 ReDistill Qwen 1.5B v1.0
DeepSeek · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
OC
occamy 1.0 mtp
Occamy · moontato
Params1.86B
Context256K
Q4_K_M1.3 GB
MI
minicpm5 1B GLM 5.2 Agentic v8
MiniCPM · hudsongouge
Params1.08B
Context128K
Q4_K_M0.7 GB
KA
Kakaocorp.Kanana 1.5 2.1b Instruct 2505
Kanana · DevQuasar
Params2.32B
Context32K
Q4_K_M1.5 GB
GT
gte-large
Gte · ChristianAzinn
Params334M
Context512
Q4_K_M0.2 GB
QW
chinese text correction 1.5b
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
MI
MiniMax Music3
Minimax · Abiray
Params2.46B
Context—
Q4_K_M1.5 GB
LL
Llama 3.2 3B Instruct
Llama · lahirum
Params3.21B
Context128K
Smallest1.9 GB
PH
Phi Bode
Phi · dagbs
Params2.78B
Context2K
Q4_K_M1.7 GB
GE
gemma 4 12b it MTP
Gemma · cloudnathan5
Params423M
Context256K
Q4_K_M0.3 GB