Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
PO
pocket tts without voice cloning q8
Pocket · lmz
Params109M
Context—
Smallest0.1 GB
VI
VibeThinker 1.5B
Vibethinker · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
GE
Gemma 2 2b TitanFusion
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Nidum Gemma 2B Uncensored
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
Qwen2.5-Omni-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.2 GB
QW
Qwen3 1.7B
Qwen · lm-kit
Params2.03B
Context40K
Q4_K_M1.3 GB
TI
TinySwallow 1.5B Instruct
Tinyswallow · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
SA
Sailor-0.5B-Chat
Sailor · sail
Params620M
Context32K
Q4_K_M0.4 GB
MI
Mixtral-seed-pollux-v0.1
Mistral · mradermacher
Params520M
Context128K
Q4_K_M0.3 GB
QW
qwen2.5-1.5b-instruct
Qwen · Joshua65535
Params1.78B
Context32K
Q4_K_M1.1 GB
IN
InternLM2
InternLM · QuantFactory
Params1.89B
Context8K
Q4_K_M1.2 GB
MU
multilingual e5 base Q4 K M
Multilingual · dinab
Params277M
Context512
Q4_K_M0.2 GB
QW
Qwen3 Shining Lucy CODER 3.4B Brainstorm20x E32
Qwen · mradermacher
Params3.38B
Context40K
Q4_K_M2.1 GB
OP
OpenELM 450M
Openelm · mradermacher
Params457M
Context2K
Q4_K_M0.3 GB
BA
T5 Base
Base · callgg
Params110M
Context512
Smallest0.1 GB
GE
Gemma 3 1b Thinking v2
Gemma · vinhnx90
Params1B
Context32K
Q4_K_M0.8 GB
MI
MiniCPM 2B dpo fp32
MiniCPM · mradermacher
Params2.72B
Context4K
Q4_K_M1.8 GB
CH
chatterbox nano
Chatterbox · cstr
Params180M
Context—
Smallest0.3 GB
GE
Survival Uncensored Gemma 270m v2
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
HE
HelpingAI 3B hindi
Helpingai · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
RE
reader lm 1.5b
Reader · bartowski
Params1.54B
Context250K
Q4_K_M1.0 GB
TE
testingquantamodel
Testingquantamodel · Zrald
Params230M
Context125K
Smallest0.1 GB
JE
Jev-Style-2B-Decision-v4
Jev · chaoliangUNSW
Params1.88B
Context256K
Q4_K_M1.3 GB
PR
SD Prompter 1.5B V0.1 i1
Prompter · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
ZE
zephyr quiklang 3b 4K
Zephyr · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
SH
YuE2-3B
Sheetsage · thepatch
Params677M
Context24K
Q4_K_M2.5 GB
LL
Llama3.2 3B ShiningValiant2
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
CO
code review decisions
Code · yannelli
Params2.7B
Context32K
Q4_K_M1.7 GB
SA
Sailor2 1B Chat
Sailor · bartowski
Params988M
Context32K
Q4_K_M0.7 GB
QW
Qwen3.8 27B FrostDFlash
Qwen · Plaguekind
Params2.09B
Context256K
Smallest1.0 GB