Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO MTP DFlash2
Qwen · Arkha7
Params461M
Context256K
Smallest13.3 GB
GGUF
HY
Hy MT2 1.8B 1.25Bit
tencent
Params1.79B
Context256K
Smallest0.5 GB
GGUF
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · TinyLlama
Params1.1B
Context2K
Smallest0.6 GB
Coding
GE
Gemma 3 270m Qat Q4_0 Unquantized
Gemma · ggml-org
Params268M
Context32K
Smallest0.2 GB
GGUF
FU
sayit asr
Fun · cswk
Params830M
Context—
Q4_K_M0.5 GB
GGUF
QW
Qwen2.5-Omni-3B
Qwen · unsloth
Params3.4B
Context32K
Q4_K_M2.1 GB
Vision
QW
Qwen2.5 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
WH
whisper tiny
Whisper · FL33TW00D-HF
Params38M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 ELVEZ Q2
DeepSeek · elvezjp
Params485M
Context—
Smallest1.0 GB
GGUF
PH
phonon 40m fr
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.5 0.8 Cyber
Qwen · reaperdoesntknow
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen3.5 2B CyberSec
Qwen · reaperdoesntknow
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
ST
sd3.5 medium
Stable · calcuis
Params2.47B
Context—
Q4_K_M1.8 GB
GGUF
HY
Hy MT2 1.8B
mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
MU
multilingual e5 small
Multilingual · cstr
Params118M
Context512
Smallest0.1 GB
Embedding
QW
Qwen2.5 Coder 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
GR
Granite 3.3 2b Instruct
Granite · ibm-granite
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
PH
phonon 40m pt
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
GGUF
FI
FireRedPunc
Fireredpunc · cstr
Params102M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.6 35B A3B MTP
Qwen · havenoammo
Params845M
Context256K
Smallest0.9 GB
GGUF
LF
LFM2.5 Audio 1.5B GGUF LEAP
Lfm · LiquidAI
Params1.17B
Context—
Smallest0.1 GB
GGUF
GR
Granite-4.1-3B
Granite · unsloth
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
NU
nuextract 1.5 tiny mealie ingredient parser
Nuextract · abyrne55
Params494M
Context32K
Smallest0.5 GB
GGUF
RW
rwkv 6 world 3b
Rwkv · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
GGUF
OR
Ornith 1.5 35B A3B Heretic MTP APEX GSQ RCO
Ornith · lavendercomputing
Params447M
Context256K
Smallest13.4 GB
Vision
DO
dots.ocr
Dots · ggml-org
Params1.78B
Context128K
Smallest1.9 GB
Vision
PA
Parakeet TDT-CTC 110M
Parakeet · handy-computer
Params114M
Context—
Q4_K_M0.1 GB
GGUF
NA
VisionPsy Nano 460M GGUFs
Nanovlm · qvac
Params409M
Context8K
Q4_K_M0.3 GB
Vision
NE
NVIDIA Nemotron 3.5 Bolt E4B 4GB DFlash
Nemotron · nvidia
Params360M
Context128K
Smallest0.7 GB
ReasoningTool use
QW
qwen image 2.1
Qwen · gguf-org
Params338M
Context256K
Q4_K_M5.0 GB
Vision

Other sizes

Keep browsing