Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Qwen3 VL 2B Instruct Abliterated v1
Qwen · prithivMLmods
Params1.72B
Context256K
Q4_K_M1.1 GB
TE
test gguf models
Test · ngxson
Params2B
Context32K
Q4_K_M1.2 GB
QW
qwen 2.5 coder Uncensored
Qwen · TobiasLogic
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama OuteTTS 1.0 1B
Llama · OuteAI
Params1.25B
Context128K
Q4_K_M0.8 GB
FL
flux.1 schnell
Flux · Green-Sky
Params84M
Context—
Smallest0.1 GB
QW
dgpl linux assistant 0.8b
Qwen · dgpl
Params752M
Context256K
Q4_K_M0.5 GB
PY
Pythia 160m
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
QW
Qwen3 1.7B Jailbreak Reasoning
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
QW
Qwen3.5 9B heretic imatrix
Qwen · FadedRedStar
Params456M
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Bharat Tiny LLM v3
Qwen · eulogik
Params1.72B
Context32K
Q4_K_M1.1 GB
DE
DeepSeek OCR
DeepSeek · sabafallah
Params2.93B
Context—
Q4_K_M2.0 GB
TI
Tinyllama 15M
Tinyllama · QuantFactory
Params15M
Context256
Q4_K_M0.0 GB
ST
stt en fastconformer ctc large
Stt · cstr
Params116M
Context—
Smallest0.1 GB
GR
granite 3b code base 128k
Granite · QuantFactory
Params3.48B
Context125K
Q4_K_M2.1 GB
GR
granite docling 258M
Granite · ggml-org
Params164M
Context8K
Smallest0.2 GB
IN
InternVL3 2B Instruct
Internvl · ggml-org
Params1.78B
Context32K
Q4_K_M1.1 GB
PH
Phonon-2
Phonon · cstr
Params627M
Context—
Smallest0.4 GB
QW
Qwen3.5 9B DFlash
Qwen · Anbeeld
Params1.29B
Context256K
Q4_K_M0.8 GB
QW
Qwen3.5 2B GPT 5.1 HighIQ INSTRUCT
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3 5 2b
Qwen · diodel
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
OP
OpenELM 450M Instruct
Openelm · mradermacher
Params457M
Context2K
Q4_K_M0.3 GB
QW
Qwen3.8-27B-DFlash2
Qwen · HermiHg
Params1.92B
Context256K
Smallest0.6 GB
FU
Fun-ASR-Nano-2512
Fun · cstr
Params985M
Context—
Smallest0.9 GB
SP
Spark-X2.5-1.7B
Spark · Mungert
Params1.71B
Context1024K
Q4_K_M1.1 GB
LL
Home Llama 3.2 3B
Llama · acon96
Params3.21B
Context128K
Q4_K_M2.0 GB
DA
danube2-1.8b-WizardLM-Evol-V2-Unfiltered
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · unsloth
Params1.71B
Context8K
Q4_K_M1.1 GB
EM
Sakura EmbeddingGemma 2 HighQuality
Embeddinggemma · webmp3
Params271M
Context—
Smallest0.0 GB