Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
KL
Klyrune 2B General
Klyrune · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
BO
Borealis Open 1b
Borealis · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
LF
Kulyk En Uk
Lfm · Yehor
Params354M
Context125K
Smallest0.4 GB
GGUF
GE
Gemma 3 1b It
Gemma · gguf-org
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
DE
deepseek-coder-1.3B-kexer
DeepSeek · lmstudio-community
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
LE
LeVo2
Levo · ckadirt
Params663M
Context—
Q4_K_M0.6 GB
GGUF
OP
Openhands Lm 1.5b v0.1
Openhands · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
ST
Starcoder2 3b
StarCoder · mradermacher
Params3.03B
Context16K
Q4_K_M1.9 GB
Coding
PH
LMCocktail phi 2 v1
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
FU
Functiongemma 270m It
Functiongemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
ST
SDXL
Stable · HyperX-Sentience
Params2.57B
Context—
Smallest1.5 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
VE
Veloxy SLM 3B
Veloxy · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
Qwen2.5 3B Instruct heretic
Qwen · saidutta69
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
SH
shisa v2.1c lfm2 350m
Shisa · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
JI
Jina Reranker M0
Jina · jinaai
Params1.54B
Context32K
Q4_K_M1.0 GB
Embedding
MA
Mamba 370m Hf
Mamba · mradermacher
Params372M
Context1024K
Q4_K_M0.2 GB
GGUF
LF
Kulyk Uk En
Lfm · Yehor
Params354M
Context125K
Smallest0.4 GB
GGUF
QW
Qwen2.5 VL 3B Instruct
Qwen · DhruvalLabs
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
AN
ANTRU 3B
Antru · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
Qwen3Guard Gen 0.6B
Qwen · mradermacher
Params752M
Context32K
Q4_K_M0.5 GB
GGUF
BA
T5 Base
Base · chatpig
Params223M
Context512
Q4_K_M0.1 GB
Coding
TT
f5 tts
Tts · cstr
Params351M
Context—
Smallest0.0 GB
GGUF
TI
TIPO 100M
Tipo · KBlueLeaf
Params100M
Context8K
Smallest0.2 GB
Vision
GR
granite-4.0-h-350m
Granite · Mungert
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
PY
pythia-1.4b-dpo-full
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
QW
Samantha-qwen-0.5b-ptbr
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LI
Lite Oute 1 300M Instruct
Lite · mradermacher
Params300M
Context4K
Q4_K_M0.2 GB
GGUF
LA
labse
Labse · ChristianAzinn
Params470M
Context512
Q4_K_M0.4 GB
Embedding
QW
Qwen2.5 1.5B Instruct heretic
Qwen · saidutta69
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF

Other sizes

Keep browsing