Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
IR
Irwan LightOnOCR 3 0.8B Abliterated
Irwan · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
TH
Thanos 3B
Thanos · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
ZE
gguf zephyr 220m dpo full
Zephyr · Felladrin
Params218M
Context2K
Q4_K_M0.2 GB
SA
SauerkrautLM-1.5b
Sauerkrautlm · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen 2.5 3B GRPO Reasoning XIOSERV
Qwen · AaryanK
Params3.09B
Context32K
Smallest2.2 GB
MA
Mamba gpt 3B v4 ggml and
Mamba · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
MU
Muse-Glimmer-30B-DFlash2
Muse · z-lab
Params2.77B
Context128K
Q4_K_M1.6 GB
QW
Qwen3.5 2b Grpo Synsql
Qwen · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
GR
granite-3b-code-glaive-20k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GE
gemma 2b it GGUF smashed
Gemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
LI
LightOnOCR 3 0.8B
Lightonocr · richardyoung
Params752M
Context256K
Q4_K_M0.5 GB
PA
Pallete 2.6B RP Reasoning 2609 V1A
Pallete · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
MX
mxbai-rerank-large-v2
Mxbai · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
SE
SeaLLMs v3 1.5B Chat
Seallms · RichardErkhov
Params1.54B
Context128K
Q4_K_M1.0 GB
JA
AI21 Jamba2 3B
Jamba · bartowski
Params3.2B
Context256K
Q4_K_M1.9 GB
GR
Granite Vision 3.2 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
QW
Ektome Qwen2.5 3Bi PristinelyUncensored
Qwen · Zynerji
Params3.09B
Context32K
Q4_K_M1.9 GB
FA
Faust 1
Faust · tabularisai
Params1.61B
Context40K
Smallest1.7 GB
CH
chinese alpaca 2 1.3b rlhf
Chinese · hfl
Params1.26B
Context4K
Smallest0.6 GB
JE
Jedi 3B 1080p
Jedi · bartowski
Params3.09B
Context125K
Q4_K_M1.9 GB
WI
Wiguel AI
Wiguel · Miguelms13
Params1.78B
Context—
Smallest1.1 GB
AC
AceTranslatePro models
Acetranslatepro · tianclll
Params1.78B
Context256K
Q4_K_M1.1 GB
MI
Huihui Ministral 3B Instruct 2512 abliterated
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
TI
TinyLlama 1.1B Chat v0.2
Tinyllama · kirp
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwopus3.6 35B A3B v1 MTP HF
Qwen · Jackrong
Params447M
Context256K
Q4_K_M21.7 GB
SP
Spark X2.6 4B EAGLE3
Spark · VitreousCut
Params218M
Context4K
Smallest0.4 GB
PY
Pythia 70m
Pythia · mradermacher
Params70M
Context2K
Q4_K_M0.0 GB
LF
LFM2.5 1.2B Z Image Engineer V4
Lfm · BennyDaBall
Params1.17B
Context125K
Q4_K_M0.7 GB