Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
SA
Sarvam 2b v0.5
Sarvam · mradermacher
Params2.51B
Context8K
Q4_K_M1.5 GB
MI
MiniCPM5 1B SFT
MiniCPM · mradermacher
Params1.08B
Context128K
Q4_K_M0.7 GB
GE
Gemma 3 1b It
Gemma · gaianet
Params1B
Context32K
Q4_K_M0.8 GB
QW
Aether-Qwen2-0.5B-SFT-v0.0.2
Qwen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
QW
Qwen2.5 1.5B Instruct uncensored
Qwen · thirdeyeai
Params1.78B
Context32K
Smallest1.3 GB
PH
Phonon 40M multilingual
Phonon · empyrealworks
Params51M
Context—
Smallest0.1 GB
MA
Marx 3B V2 i1
Marx · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
GR
Granite 3.3 2B Instruct BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
QW
Qwen3-1.7B
Qwen · openwalrus
Params1.72B
Context40K
Q4_K_M1.1 GB
MI
MiniCPM 5 2B KomorAI
MiniCPM · KomorAI
Params2.52B
Context128K
Q4_K_M1.6 GB
GE
Leniachat Gemma 2b v0
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
TI
TinySlime-1.1B-v1.0
Tinyslime · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
NO
Nomic Embed Text v1.5
Nomic · mradermacher
Params137M
Context2K
Q4_K_M0.1 GB
FR
FriendModel 112M
Friendmodel · GlowingLanternAIQuest
Params163M
Context2K
Smallest0.2 GB
MI
Ministral 3 3B Medical Reasoning
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
CS
Csg Wukong 1B
Csg · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen3 MOE 4x0.6B 2.4B Writing Thunder V1.2
Qwen · mradermacher
Params1.54B
Context40K
Q4_K_M1.0 GB
EM
EMO 1.5B GGUF smashed
Emo · PrunaAI
Params1.84B
Context4K
Q4_K_M1.2 GB
MO
MOA
Moa · MOAIIA
Params3B
Context32K
Smallest2.1 GB
QW
Qwen3.8-27B-DFlash2
Qwen · analogalok
Params1.92B
Context256K
Smallest0.7 GB
SM
SmolLM 135M Instruct
SmolLM · second-state
Params135M
Context2K
Q4_K_M0.1 GB
ST
stable-code-instruct-3b
Stable · duyntnet
Params2.8B
Context16K
Q4_K_M1.7 GB
GE
gemma 3 1b instruct
Gemma · lm-kit
Params1B
Context32K
Q4_K_M0.8 GB
CA
CAT Translate 0.8b
Cat · mmnga-o
Params793M
Context8K
Q4_K_M0.5 GB
WA
wav2vec2 large xlsr 53 german
Wav · cstr
Params315M
Context—
Smallest0.2 GB
GE
gemma-1.1-2b-it
Gemma · lmstudio-community
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
Qwen3.5-2B
Qwen · Mungert
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen2.5 VL 7B Abliterated Caption it
Qwen · Andycurrent
Params3.09B
Context125K
Q4_K_M1.9 GB
MO
moonshine tiny zh
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
OU
DarijaTTS v0.1 500M
Outetts · KandirResearch
Params499M
Context32K
Smallest0.5 GB