Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
JI
jina embeddings v5 omni small text matching
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
QW
Qwen2.5 Coder 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
DI
distil whisper large v3
Distil · FL33TW00D-HF
Params756M
Context—
Smallest0.4 GB
GT
Gte Multilingual Reranker Base
Gte · gpustack
Params306M
Context8K
Q4_K_M0.2 GB
GE
models--google--gemma-2b
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
DE
deeseek r1 1.5b ft 1 q4 k m
Deeseek · maharshpatelx
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek-OCR
DeepSeek · NexaAI
Params2.93B
Context—
Smallest1.7 GB
GE
Gemma 3 1b It Abliterated
Gemma · mlabonne
Params1B
Context32K
Q4_K_M0.8 GB
QW
Qwen2.5 1.5B K2 3.34bpw
Qwen · TitanMamo10
Params596M
Context128K
Smallest1.2 GB
UD
Udgam-384M-Base
Udgam · udgamlabs
Params384M
Context2K
Smallest0.4 GB
GR
Granite Docling 258M
Granite · ibm-granite
Params164M
Context8K
Smallest0.3 GB
SM
Smollm2 1.7b Uncensored
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
QW
Qwen3.5 2B Uncensored Ara
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen2 1.5B Spanish 1.0
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
gutsy
Qwen · kouhxp
Params752M
Context256K
Q4_K_M0.5 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
GR
Granite 4.0 H 350m
Granite · mrutkows
Params340M
Context1024K
Q4_K_M0.2 GB
QW
youtube audiobook title parser
Qwen · Salahin
Params494M
Context32K
Q4_K_M0.4 GB
QW
Huihui Qwen3 VL 2B Instruct Abliterated
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
D1
d1 2B
AtomicChat
Params1.73B
Context125K
Q4_K_M1.1 GB
MU
Muse Glimmer 30B Uncensored Heretic
Muse · cvgro
Params2.77B
Context128K
Q4_K_M16.9 GB
JI
jina embeddings v2 base en
Jina · second-state
Params137M
Context8K
Q4_K_M0.1 GB
QW
Qwen2.5 VL 3B Instruct
Qwen · Taoufik
Params3.09B
Context125K
Q4_K_M1.9 GB
MI
timestral cpp
Mistral · mudler
Params123M
Context32K
Smallest0.0 GB
QW
Qwen3 1.7B Coder Distilled SFT
Qwen · tinyopsec
Params2.03B
Context40K
Q4_K_M1.3 GB
IN
Intern Decision 2B
InternLM · bombdefuser-124
Params1.88B
Context256K
Smallest2.0 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
FL
Flint-DFlash2
Flint · incoai
Params403M
Context256K
Q4_K_M0.2 GB
FL
Fluxnat Coder 3B
Fluxnat · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
AT
Atlas Chat 2B
Atlas · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB