Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
GR
Granite 3.3 2b Base
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
granite 3b code base 2k
Granite · QuantFactory
Params3.48B
Context2K
Q4_K_M2.1 GB
SM
SmolLM 360M
SmolLM · QuantFactory
Params362M
Context2K
Q4_K_M0.3 GB
QW
qwen2.5 coder 3b pentest
Qwen · fawazo
Params3.1B
Context32K
Q4_K_M1.9 GB
TH
Thanos 3B i1
Thanos · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GR
granite 4.1 3b heretic
Granite · saidutta69
Params3.4B
Context128K
Q4_K_M2.1 GB
QW
xpo-qwen2
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
MI
Minerva 3B base RAG
Minerva · QuantFactory
Params2.89B
Context16K
Q4_K_M1.8 GB
TI
Tinyllama 1.1b Abliterated
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GR
Granite 3.0 2b Instruct
Granite · bartowski
Params2.63B
Context4K
Q4_K_M1.6 GB
XL
xLAM 2 1b Fc R
Xlam · Salesforce
Params1.54B
Context32K
Q4_K_M1.0 GB
MI
Ministral 3 3B Claude Opus Reasoning Distilled
Mistral · xtools-at
Params3.43B
Context256K
Q4_K_M2.1 GB
LL
AMD Llama 135m
Llama · QuantFactory
Params134M
Context2K
Q4_K_M0.1 GB
ZA
Archai Jev Zagreus 0.4b Ita Merged
Zagreus · nickprock
Params438M
Context4K
Smallest0.5 GB
LA
laya multilingual
Laya · Weidows
Params307M
Context8K
Q4_K_M0.2 GB
LL
Llama 3.2 3B Instruct
Llama · hugging-quants
Params3.21B
Context128K
Smallest3.4 GB
MI
zubr mini 1.9 3b
Mistral · alekringtonnn-ai
Params3.43B
Context256K
Q4_K_M2.1 GB
ST
stable code 3b
Stable · QuantFactory
Params2.8B
Context16K
Q4_K_M1.7 GB
AR
Arabic English Handwritten OCR v3
Arabic · mradermacher
Params3.1B
Context125K
Q4_K_M1.9 GB
GE
Gemma 4 1B 0.8B Tiny
Gemma · mradermacher
Params977M
Context256K
Q4_K_M0.7 GB
CO
cohere transcribe ja v0.1
Cohere · TransWithAI
Params2.07B
Context—
Smallest1.5 GB
SM
SmallThinker 3B Preview
Smallthinker · bartowski
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · sheldonrobinson
Params1.54B
Context32K
Q4_K_M1.0 GB
IN
Index Homura 2B
Index · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
OR
Orpeus_Text_To_Speech
Orpheus · D-Khalid
Params3.3B
Context128K
Q4_K_M2.1 GB
GR
Granite Vision 3.2 2b
Granite · bartowski
Params2.53B
Context16K
Q4_K_M1.5 GB
QW
Arch Router
Qwen · katanemo
Params1.54B
Context32K
Q4_K_M1.0 GB
EM
EmbeddingGemma 300m
Embeddinggemma · lmstudio-community
Params303M
Context2K
Smallest0.2 GB
ST
stable diffusion xl inpainting 1.0
Stable · gpustack
Params3.47B
Context—
Smallest3.8 GB
TI
TinyMistral 248M
Tinymistral · afrideva
Params248M
Context32K
Q4_K_M0.2 GB