Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
XL
pcs xlmr base
Xlm · cstr
Params278M
Context—
Smallest0.2 GB
GGUF
WH
whisper medium
Whisper · OllmOne
Params764M
Context—
Smallest0.4 GB
GGUF
EM
Embeddinggemma 2
Embeddinggemma · prithivMLmods
Params271M
Context256K
Q4_K_M0.2 GB
EmbeddingVision
QW
XiYanSQL QwenCoder 3B 2504
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B
Nemotron · natalie5
Params1.63B
Context1024K
Smallest1.3 GB
Vision
GE
guarani jopara gemma 2 2b it v1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen2.5 1.5B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
FA
Falcon-H1-1.5B-Instruct
Falcon · unsloth
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
SP
TitaNet-Large
Speakerverification · cstr
Params22M
Context—
Smallest0.0 GB
GGUF
IN
InkubaLM 0.4B
Inkubalm · QuantFactory
Params664M
Context2K
Q4_K_M0.4 GB
GGUF
QW
Qwen2.5 3B sex GPRO float16
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen3.5 2B Base
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
GR
Granite 3.2 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GE
Gemma 2 2B Stheno Filtered i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Warumauchimmer
Params1.86B
Context—
Smallest0.9 GB
GGUF
GE
gemma 4 26B A4B it qat MTP
Gemma · magnitudedev
Params420M
Context128K
Smallest0.3 GB
ReasoningTool use
QW
Brie v2 Qwen2.5 3b
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen1.5-0.5B-Chat
Qwen · second-state
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
FA
Falcon3 1B Instruct Abliterated
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
DI
DialoGPT small crybaby
Dialogpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
MedASR
Medasr · handy-computer
Params105M
Context—
Q4_K_M0.1 GB
GGUF
GE
Dolphin 2.9.4 Gemma2 2b
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
MiniCPM V 4.6 Heretic
MiniCPM · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Vision
VI
mythos fast
Vibethinker · Shadow0482
Params3.1B
Context128K
Q4_K_M1.9 GB
Tool use
LI
sd3.5 lite
Lite · calcuis
Params2.47B
Context—
Q4_K_M1.8 GB
GGUF
IR
Irodori-TTS-v4.1-Small
Irodori · sakasegawa
Params859M
Context—
Smallest0.9 GB
GGUF
EX
EXAONE Deep 2.4B
Exaone · bartowski
Params2.41B
Context32K
Q4_K_M1.5 GB
GGUF
GE
Gemma 2 2b All in One i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen3.8 1.0B A0.6B
Qwen · TEKIBO
Params966M
Context256K
Smallest0.6 GB
GGUF
HU
hyvid i2v
Hunyuanvideo · calcuis
Params123M
Context—
Q4_K_M7.7 GB
GGUF

Other sizes

Keep browsing