Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO MTP DFlash2
Qwen · Arkha7
Params461M
Context256K
Smallest13.3 GB
HY
Hy MT2 1.8B 1.25Bit
tencent
Params1.79B
Context256K
Smallest0.5 GB
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · TinyLlama
Params1.1B
Context2K
Smallest0.6 GB
GE
Gemma 3 270m Qat Q4_0 Unquantized
Gemma · ggml-org
Params268M
Context32K
Smallest0.2 GB
FU
sayit asr
Fun · cswk
Params830M
Context—
Q4_K_M0.5 GB
QW
Qwen2.5-Omni-3B
Qwen · unsloth
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
Qwen2.5 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
WH
whisper tiny
Whisper · FL33TW00D-HF
Params38M
Context—
Smallest0.0 GB
DE
DeepSeek V4.1 Flash 1017 ELVEZ Q2
DeepSeek · elvezjp
Params485M
Context—
Smallest1.0 GB
PH
phonon 40m fr
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
QW
Qwen3.5 0.8 Cyber
Qwen · reaperdoesntknow
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3.5 2B CyberSec
Qwen · reaperdoesntknow
Params1.94B
Context256K
Q4_K_M1.3 GB
ST
sd3.5 medium
Stable · calcuis
Params2.47B
Context—
Q4_K_M1.8 GB
HY
Hy MT2 1.8B
mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
MU
multilingual e5 small
Multilingual · cstr
Params118M
Context512
Smallest0.1 GB
QW
Qwen2.5 Coder 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GR
Granite 3.3 2b Instruct
Granite · ibm-granite
Params2.53B
Context128K
Q4_K_M1.5 GB
PH
phonon 40m pt
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
FI
FireRedPunc
Fireredpunc · cstr
Params102M
Context—
Smallest0.1 GB
QW
Qwen3.6 35B A3B MTP
Qwen · havenoammo
Params845M
Context256K
Smallest0.9 GB
LF
LFM2.5 Audio 1.5B GGUF LEAP
Lfm · LiquidAI
Params1.17B
Context—
Smallest0.1 GB
GR
Granite-4.1-3B
Granite · unsloth
Params3.4B
Context128K
Q4_K_M2.1 GB
NU
nuextract 1.5 tiny mealie ingredient parser
Nuextract · abyrne55
Params494M
Context32K
Smallest0.5 GB
RW
rwkv 6 world 3b
Rwkv · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
OR
Ornith 1.5 35B A3B Heretic MTP APEX GSQ RCO
Ornith · lavendercomputing
Params447M
Context256K
Smallest13.4 GB
DO
dots.ocr
Dots · ggml-org
Params1.78B
Context128K
Smallest1.9 GB
PA
Parakeet TDT-CTC 110M
Parakeet · handy-computer
Params114M
Context—
Q4_K_M0.1 GB
NA
VisionPsy Nano 460M GGUFs
Nanovlm · qvac
Params409M
Context8K
Q4_K_M0.3 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B 4GB DFlash
Nemotron · nvidia
Params360M
Context128K
Smallest0.7 GB
QW
qwen image 2.1
Qwen · gguf-org
Params338M
Context256K
Q4_K_M5.0 GB