Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Qwen3.5-0.8B
Qwen · NobodyWho
Params752M
Context256K
Q4_K_M0.5 GB
GE
gemma 4 26B A4B it MTP
Gemma · ironbcc
Params420M
Context256K
Q4_K_M0.3 GB
NE
neutts air
Neutts · neuphonic
Params750M
Context—
Smallest1.5 GB
GR
Parable Granite 4.1 3B Claude Fable 5 heretic
Granite · saidutta69
Params3.4B
Context128K
Q4_K_M2.1 GB
JI
jina ocr v1
Jina · ahmadw
Params2.93B
Context—
Q4_K_M2.0 GB
LF
LiquidAI_LFM2.5-2.6B__project-lfm2.5-2.6b-cybersec_1786722551
Lfm · reaperdoesntknow
Params2.7B
Context128K
Q4_K_M1.7 GB
ST
StartLux Decision v1 2B Q8 0
Startlux · startlux-models
Params1.88B
Context256K
Smallest2.0 GB
AR
ArmenianGPT 1.0 3B
Armeniangpt · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
LF
LFM2.5-24B-A2B-DSpark
Lfm · LiquidAI
Params328M
Context128K
Smallest0.7 GB
CO
C4AI orpo model
Command R · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
JI
Jina Embeddings v5 Text Nano Clustering
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · ggml-org
Params1.54B
Context32K
Smallest1.6 GB
QW
Qwen3.8 27B DSpark
Qwen · Anbeeld
Params1.86B
Context256K
Q4_K_M1.1 GB
MI
Lora8B
Minimax · pytraveler
Params700M
Context—
Smallest0.7 GB
VI
vibevoice
Vibevoice · gguf-org
Params2.7B
Context—
Q4_K_M3.5 GB
TA
tada tts 1b
Tada · cstr
Params447M
Context—
Smallest0.0 GB
OR
Orpheus 3b 0.1 Pretrained GGUF
Orpheus · HorizonNexusAI
Params3.3B
Context128K
Q4_K_M2.1 GB
OP
OpenELM-270M-Instruct
Openelm · RichardErkhov
Params272M
Context2K
Q4_K_M0.2 GB
QW
Qwen3.5 0.8B Heretic
Qwen · saidutta69
Params752M
Context256K
Q4_K_M0.5 GB
AN
AnLLM-EP-xllarge-wikiart
Anllm · mradermacher
Params368M
Context4K
Q4_K_M0.2 GB
GR
Granite 3b Code Base 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
MI
MiniCPM V 4.7 1B
MiniCPM · prithivMLmods
Params1.01B
Context256K
Q4_K_M0.7 GB
LL
Llama32 1b Llm Abliteration
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
QW
TinySwallow 1.5B Instruct
Qwen · SakanaAI
Params1.54B
Context32K
Smallest1.1 GB
QW
UmarTransit 1B
Qwen · umarfarookm
Params1.54B
Context32K
Q4_K_M1.0 GB
ST
stable-code-instruct-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
QW
QwenDGAF Coder 3B
Qwen · hecan3d
Params3.1B
Context32K
Q4_K_M1.9 GB
EM
Emma 6 Hf
Emma · PaoloneSborracchione
Params1.55B
Context4K
Q4_K_M1.0 GB
DA
danube2-1.8b-Synthia-v1.3
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB