Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
KL
Klyrune 2B General
Klyrune · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
BO
Borealis Open 1b
Borealis · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
LF
Kulyk En Uk
Lfm · Yehor
Params354M
Context125K
Smallest0.4 GB
GE
Gemma 3 1b It
Gemma · gguf-org
Params1B
Context32K
Q4_K_M0.8 GB
DE
deepseek-coder-1.3B-kexer
DeepSeek · lmstudio-community
Params1.35B
Context16K
Q4_K_M0.9 GB
LE
LeVo2
Levo · ckadirt
Params663M
Context—
Q4_K_M0.6 GB
OP
Openhands Lm 1.5b v0.1
Openhands · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
ST
Starcoder2 3b
StarCoder · mradermacher
Params3.03B
Context16K
Q4_K_M1.9 GB
PH
LMCocktail phi 2 v1
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
FU
Functiongemma 270m It
Functiongemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
ST
SDXL
Stable · HyperX-Sentience
Params2.57B
Context—
Smallest1.5 GB
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
VE
Veloxy SLM 3B
Veloxy · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2.5 3B Instruct heretic
Qwen · saidutta69
Params3.09B
Context32K
Q4_K_M1.9 GB
SH
shisa v2.1c lfm2 350m
Shisa · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
JI
Jina Reranker M0
Jina · jinaai
Params1.54B
Context32K
Q4_K_M1.0 GB
MA
Mamba 370m Hf
Mamba · mradermacher
Params372M
Context1024K
Q4_K_M0.2 GB
LF
Kulyk Uk En
Lfm · Yehor
Params354M
Context125K
Smallest0.4 GB
QW
Qwen2.5 VL 3B Instruct
Qwen · DhruvalLabs
Params3.09B
Context125K
Q4_K_M1.9 GB
AN
ANTRU 3B
Antru · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen3Guard Gen 0.6B
Qwen · mradermacher
Params752M
Context32K
Q4_K_M0.5 GB
BA
T5 Base
Base · chatpig
Params223M
Context512
Q4_K_M0.1 GB
TT
f5 tts
Tts · cstr
Params351M
Context—
Smallest0.0 GB
TI
TIPO 100M
Tipo · KBlueLeaf
Params100M
Context8K
Smallest0.2 GB
GR
granite-4.0-h-350m
Granite · Mungert
Params340M
Context1024K
Q4_K_M0.2 GB
PY
pythia-1.4b-dpo-full
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
QW
Samantha-qwen-0.5b-ptbr
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
LI
Lite Oute 1 300M Instruct
Lite · mradermacher
Params300M
Context4K
Q4_K_M0.2 GB
LA
labse
Labse · ChristianAzinn
Params470M
Context512
Q4_K_M0.4 GB
QW
Qwen2.5 1.5B Instruct heretic
Qwen · saidutta69
Params1.54B
Context32K
Q4_K_M1.0 GB