Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 3.3 2b Base
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
granite 3b code base 2k
Granite · QuantFactory
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
SM
SmolLM 360M
SmolLM · QuantFactory
Params362M
Context2K
Q4_K_M0.3 GB
Tool use
QW
qwen2.5 coder 3b pentest
Qwen · fawazo
Params3.1B
Context32K
Q4_K_M1.9 GB
Coding
TH
Thanos 3B i1
Thanos · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
GR
granite 4.1 3b heretic
Granite · saidutta69
Params3.4B
Context128K
Q4_K_M2.1 GB
RoleplayTool use
QW
xpo-qwen2
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
MI
Minerva 3B base RAG
Minerva · QuantFactory
Params2.89B
Context16K
Q4_K_M1.8 GB
GGUF
TI
Tinyllama 1.1b Abliterated
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
GR
Granite 3.0 2b Instruct
Granite · bartowski
Params2.63B
Context4K
Q4_K_M1.6 GB
GGUF
XL
xLAM 2 1b Fc R
Xlam · Salesforce
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
MI
Ministral 3 3B Claude Opus Reasoning Distilled
Mistral · xtools-at
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool useVision
LL
AMD Llama 135m
Llama · QuantFactory
Params134M
Context2K
Q4_K_M0.1 GB
GGUF
ZA
Archai Jev Zagreus 0.4b Ita Merged
Zagreus · nickprock
Params438M
Context4K
Smallest0.5 GB
GGUF
LA
laya multilingual
Laya · Weidows
Params307M
Context8K
Q4_K_M0.2 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · hugging-quants
Params3.21B
Context128K
Smallest3.4 GB
GGUF
MI
zubr mini 1.9 3b
Mistral · alekringtonnn-ai
Params3.43B
Context256K
Q4_K_M2.1 GB
Tool useVision
ST
stable code 3b
Stable · QuantFactory
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
AR
Arabic English Handwritten OCR v3
Arabic · mradermacher
Params3.1B
Context125K
Q4_K_M1.9 GB
Vision
GE
Gemma 4 1B 0.8B Tiny
Gemma · mradermacher
Params977M
Context256K
Q4_K_M0.7 GB
GGUF
CO
cohere transcribe ja v0.1
Cohere · TransWithAI
Params2.07B
Context—
Smallest1.5 GB
GGUF
SM
SmallThinker 3B Preview
Smallthinker · bartowski
Params3.4B
Context32K
Q4_K_M2.1 GB
Reasoning
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · sheldonrobinson
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
IN
Index Homura 2B
Index · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
Vision
OR
Orpeus_Text_To_Speech
Orpheus · D-Khalid
Params3.3B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite Vision 3.2 2b
Granite · bartowski
Params2.53B
Context16K
Q4_K_M1.5 GB
Vision
QW
Arch Router
Qwen · katanemo
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
EM
EmbeddingGemma 300m
Embeddinggemma · lmstudio-community
Params303M
Context2K
Smallest0.2 GB
Embedding
ST
stable diffusion xl inpainting 1.0
Stable · gpustack
Params3.47B
Context—
Smallest3.8 GB
GGUF
TI
TinyMistral 248M
Tinymistral · afrideva
Params248M
Context32K
Q4_K_M0.2 GB
GGUF

Other sizes

Keep browsing