Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 VL 2B Instruct Abliterated v1
Qwen · prithivMLmods
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
TE
test gguf models
Test · ngxson
Params2B
Context32K
Q4_K_M1.2 GB
GGUF
QW
qwen 2.5 coder Uncensored
Qwen · TobiasLogic
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
LL
Llama OuteTTS 1.0 1B
Llama · OuteAI
Params1.25B
Context128K
Q4_K_M0.8 GB
GGUF
FL
flux.1 schnell
Flux · Green-Sky
Params84M
Context—
Smallest0.1 GB
GGUF
QW
dgpl linux assistant 0.8b
Qwen · dgpl
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
PY
Pythia 160m
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
QW
Qwen3 1.7B Jailbreak Reasoning
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen3.5 9B heretic imatrix
Qwen · FadedRedStar
Params456M
Context256K
Q4_K_M5.6 GB
CodingVision
QW
Qwen2.5 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Bharat Tiny LLM v3
Qwen · eulogik
Params1.72B
Context32K
Q4_K_M1.1 GB
Tool use
DE
DeepSeek OCR
DeepSeek · sabafallah
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
TI
Tinyllama 15M
Tinyllama · QuantFactory
Params15M
Context256
Q4_K_M0.0 GB
GGUF
ST
stt en fastconformer ctc large
Stt · cstr
Params116M
Context—
Smallest0.1 GB
GGUF
GR
granite 3b code base 128k
Granite · QuantFactory
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
GR
granite docling 258M
Granite · ggml-org
Params164M
Context8K
Smallest0.2 GB
Vision
IN
InternVL3 2B Instruct
Internvl · ggml-org
Params1.78B
Context32K
Q4_K_M1.1 GB
Vision
PH
Phonon-2
Phonon · cstr
Params627M
Context—
Smallest0.4 GB
GGUF
QW
Qwen3.5 9B DFlash
Qwen · Anbeeld
Params1.29B
Context256K
Q4_K_M0.8 GB
CodingEmbedding
QW
Qwen3.5 2B GPT 5.1 HighIQ INSTRUCT
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
Reasoning
QW
Qwen3 5 2b
Qwen · diodel
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
OP
OpenELM 450M Instruct
Openelm · mradermacher
Params457M
Context2K
Q4_K_M0.3 GB
GGUF
QW
Qwen3.8-27B-DFlash2
Qwen · HermiHg
Params1.92B
Context256K
Smallest0.6 GB
GGUF
FU
Fun-ASR-Nano-2512
Fun · cstr
Params985M
Context—
Smallest0.9 GB
GGUF
SP
Spark-X2.5-1.7B
Spark · Mungert
Params1.71B
Context1024K
Q4_K_M1.1 GB
GGUF
LL
Home Llama 3.2 3B
Llama · acon96
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
DA
danube2-1.8b-WizardLM-Evol-V2-Unfiltered
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · unsloth
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
EM
Sakura EmbeddingGemma 2 HighQuality
Embeddinggemma · webmp3
Params271M
Context—
Smallest0.0 GB
GGUF

Other sizes

Keep browsing