Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
Sarvam 2b v0.5
Sarvam · mradermacher
Params2.51B
Context8K
Q4_K_M1.5 GB
GGUF
MI
MiniCPM5 1B SFT
MiniCPM · mradermacher
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
GE
Gemma 3 1b It
Gemma · gaianet
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
QW
Aether-Qwen2-0.5B-SFT-v0.0.2
Qwen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
Coding
QW
Qwen2.5 1.5B Instruct uncensored
Qwen · thirdeyeai
Params1.78B
Context32K
Smallest1.3 GB
Tool use
PH
Phonon 40M multilingual
Phonon · empyrealworks
Params51M
Context—
Smallest0.1 GB
GGUF
MA
Marx 3B V2 i1
Marx · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
GR
Granite 3.3 2B Instruct BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
QW
Qwen3-1.7B
Qwen · openwalrus
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
MI
MiniCPM 5 2B KomorAI
MiniCPM · KomorAI
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
GE
Leniachat Gemma 2b v0
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
TI
TinySlime-1.1B-v1.0
Tinyslime · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
NO
Nomic Embed Text v1.5
Nomic · mradermacher
Params137M
Context2K
Q4_K_M0.1 GB
Embedding
FR
FriendModel 112M
Friendmodel · GlowingLanternAIQuest
Params163M
Context2K
Smallest0.2 GB
GGUF
MI
Ministral 3 3B Medical Reasoning
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool useVision
CS
Csg Wukong 1B
Csg · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
QW
Qwen3 MOE 4x0.6B 2.4B Writing Thunder V1.2
Qwen · mradermacher
Params1.54B
Context40K
Q4_K_M1.0 GB
CodingReasoningRoleplay
EM
EMO 1.5B GGUF smashed
Emo · PrunaAI
Params1.84B
Context4K
Q4_K_M1.2 GB
GGUF
MO
MOA
Moa · MOAIIA
Params3B
Context32K
Smallest2.1 GB
GGUF
QW
Qwen3.8-27B-DFlash2
Qwen · analogalok
Params1.92B
Context256K
Smallest0.7 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · second-state
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
ST
stable-code-instruct-3b
Stable · duyntnet
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
GE
gemma 3 1b instruct
Gemma · lm-kit
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
CA
CAT Translate 0.8b
Cat · mmnga-o
Params793M
Context8K
Q4_K_M0.5 GB
GGUF
WA
wav2vec2 large xlsr 53 german
Wav · cstr
Params315M
Context—
Smallest0.2 GB
GGUF
GE
gemma-1.1-2b-it
Gemma · lmstudio-community
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
Qwen3.5-2B
Qwen · Mungert
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Qwen2.5 VL 7B Abliterated Caption it
Qwen · Andycurrent
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
MO
moonshine tiny zh
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
GGUF
OU
DarijaTTS v0.1 500M
Outetts · KandirResearch
Params499M
Context32K
Smallest0.5 GB
GGUF

Other sizes

Keep browsing