Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
XL
pcs xlmr base
Xlm · cstr
Params278M
Context—
Smallest0.2 GB
WH
whisper medium
Whisper · OllmOne
Params764M
Context—
Smallest0.4 GB
EM
Embeddinggemma 2
Embeddinggemma · prithivMLmods
Params271M
Context256K
Q4_K_M0.2 GB
QW
XiYanSQL QwenCoder 3B 2504
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B
Nemotron · natalie5
Params1.63B
Context1024K
Smallest1.3 GB
GE
guarani jopara gemma 2 2b it v1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen2.5 1.5B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
FA
Falcon-H1-1.5B-Instruct
Falcon · unsloth
Params1.55B
Context128K
Q4_K_M0.9 GB
SP
TitaNet-Large
Speakerverification · cstr
Params22M
Context—
Smallest0.0 GB
IN
InkubaLM 0.4B
Inkubalm · QuantFactory
Params664M
Context2K
Q4_K_M0.4 GB
QW
Qwen2.5 3B sex GPRO float16
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen3.5 2B Base
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
GR
Granite 3.2 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GE
Gemma 2 2B Stheno Filtered i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Warumauchimmer
Params1.86B
Context—
Smallest0.9 GB
GE
gemma 4 26B A4B it qat MTP
Gemma · magnitudedev
Params420M
Context128K
Smallest0.3 GB
QW
Brie v2 Qwen2.5 3b
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen1.5-0.5B-Chat
Qwen · second-state
Params620M
Context32K
Q4_K_M0.4 GB
FA
Falcon3 1B Instruct Abliterated
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
DI
DialoGPT small crybaby
Dialogpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
ME
MedASR
Medasr · handy-computer
Params105M
Context—
Q4_K_M0.1 GB
GE
Dolphin 2.9.4 Gemma2 2b
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
MiniCPM V 4.6 Heretic
MiniCPM · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
VI
mythos fast
Vibethinker · Shadow0482
Params3.1B
Context128K
Q4_K_M1.9 GB
LI
sd3.5 lite
Lite · calcuis
Params2.47B
Context—
Q4_K_M1.8 GB
IR
Irodori-TTS-v4.1-Small
Irodori · sakasegawa
Params859M
Context—
Smallest0.9 GB
EX
EXAONE Deep 2.4B
Exaone · bartowski
Params2.41B
Context32K
Q4_K_M1.5 GB
GE
Gemma 2 2b All in One i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen3.8 1.0B A0.6B
Qwen · TEKIBO
Params966M
Context256K
Smallest0.6 GB
HU
hyvid i2v
Hunyuanvideo · calcuis
Params123M
Context—
Q4_K_M7.7 GB