Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
PO
pocket tts without voice cloning q8
Pocket · lmz
Params109M
Context—
Smallest0.1 GB
GGUF
VI
VibeThinker 1.5B
Vibethinker · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
GE
Gemma 2 2b TitanFusion
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Nidum Gemma 2B Uncensored
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
Qwen2.5-Omni-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.2 GB
GGUF
QW
Qwen3 1.7B
Qwen · lm-kit
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
TI
TinySwallow 1.5B Instruct
Tinyswallow · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
SA
Sailor-0.5B-Chat
Sailor · sail
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
MI
Mixtral-seed-pollux-v0.1
Mistral · mradermacher
Params520M
Context128K
Q4_K_M0.3 GB
GGUF
QW
qwen2.5-1.5b-instruct
Qwen · Joshua65535
Params1.78B
Context32K
Q4_K_M1.1 GB
Tool use
IN
InternLM2
InternLM · QuantFactory
Params1.89B
Context8K
Q4_K_M1.2 GB
GGUF
MU
multilingual e5 base Q4 K M
Multilingual · dinab
Params277M
Context512
Q4_K_M0.2 GB
Embedding
QW
Qwen3 Shining Lucy CODER 3.4B Brainstorm20x E32
Qwen · mradermacher
Params3.38B
Context40K
Q4_K_M2.1 GB
CodingReasoningTool use
OP
OpenELM 450M
Openelm · mradermacher
Params457M
Context2K
Q4_K_M0.3 GB
GGUF
BA
T5 Base
Base · callgg
Params110M
Context512
Smallest0.1 GB
Coding
GE
Gemma 3 1b Thinking v2
Gemma · vinhnx90
Params1B
Context32K
Q4_K_M0.8 GB
Reasoning
MI
MiniCPM 2B dpo fp32
MiniCPM · mradermacher
Params2.72B
Context4K
Q4_K_M1.8 GB
GGUF
CH
chatterbox nano
Chatterbox · cstr
Params180M
Context—
Smallest0.3 GB
GGUF
GE
Survival Uncensored Gemma 270m v2
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
Roleplay
HE
HelpingAI 3B hindi
Helpingai · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
RE
reader lm 1.5b
Reader · bartowski
Params1.54B
Context250K
Q4_K_M1.0 GB
GGUF
TE
testingquantamodel
Testingquantamodel · Zrald
Params230M
Context125K
Smallest0.1 GB
ReasoningTool use
JE
Jev-Style-2B-Decision-v4
Jev · chaoliangUNSW
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
PR
SD Prompter 1.5B V0.1 i1
Prompter · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
ZE
zephyr quiklang 3b 4K
Zephyr · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
Tool use
SH
YuE2-3B
Sheetsage · thepatch
Params677M
Context24K
Q4_K_M2.5 GB
GGUF
LL
Llama3.2 3B ShiningValiant2
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
CO
code review decisions
Code · yannelli
Params2.7B
Context32K
Q4_K_M1.7 GB
CodingReasoningTool use
SA
Sailor2 1B Chat
Sailor · bartowski
Params988M
Context32K
Q4_K_M0.7 GB
GGUF
QW
Qwen3.8 27B FrostDFlash
Qwen · Plaguekind
Params2.09B
Context256K
Smallest1.0 GB
ReasoningTool use

Other sizes

Keep browsing