Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Qwen2.5 1.5B Instruct
Qwen · lmstudio-community
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
qwen3 tts 1.7b voicedesign
Qwen · cstr
Params1.92B
Context—
Smallest2.0 GB
HU
Hunyuan 0.5B Instruct
Hunyuan · bartowski
Params539M
Context256K
Q4_K_M0.4 GB
GR
Granite 3.1 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · Vikhrmodels
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen3 Uncensored TextEncoders Klein Z Image Anima
Qwen · LuffyTheFox
Params596M
Context40K
Smallest1.2 GB
SE
SeedVR2
Seedvr · hk6668
Params3.39B
Context—
Q4_K_M2.0 GB
LI
LightOnOCR 3 0.8B
Lightonocr · NANI-Nithin
Params752M
Context256K
Q4_K_M0.5 GB
OU
OuteTTS 0.2 500M
Outetts · OuteAI
Params500M
Context32K
Q4_K_M0.4 GB
LL
Akikawa 3.3 1b Roleplay 128K
Llama · Green-Eye
Params1.24B
Context128K
Q4_K_M0.8 GB
GR
Granite 4.0 H 1b
Granite · ibm-granite
Params1.46B
Context1024K
Q4_K_M0.9 GB
TE
NaviDC OCR
Teleocr · nandraj
Params752M
Context125K
Q4_K_M0.5 GB
DR
dreamshaper 8LCM im GGUF sdcpp
Dreamshaper · stduhpf
Params1.07B
Context—
Smallest1.5 GB
IL
illustrious xl v2.0
Illustrious · off-grid-ai
Params3.47B
Context—
Smallest2.8 GB
XL
xLAM 2 3b Fc R
Xlam · Salesforce
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · unsloth
Params1.54B
Context128K
Q4_K_M1.0 GB
SE
SEX_ROLEPLAY.v4 3.2 1B
Sex · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
PY
Pythia 2.8b Deduped
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
SM
SmolLM2 1.7B Instruct
SmolLM · lmstudio-community
Params1.71B
Context8K
Q4_K_M1.1 GB
LL
Llama 3.2 3B Instruct
Llama · DavidAU
Params3.21B
Context128K
Q4_K_M2.0 GB
GR
Granite 3b Code Instruct 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
HY
Hy MT2 1.8B 2Bit
tencent
Params1.79B
Context256K
Smallest0.6 GB
QW
qwen3 tts 0.6b base
Qwen · cstr
Params915M
Context—
Smallest0.5 GB
JI
jina embeddings v4 text matching
Jina · jinaai
Params3.1B
Context125K
Q4_K_M1.9 GB
VO
voxcpm2
Voxcpm · cstr
Params2.38B
Context—
Smallest0.0 GB
QW
Qwen3.5 abliterated MAX AIO
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
GR
Granite 3b Code Base 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
SM
SmolLM 135M
SmolLM · QuantFactory
Params135M
Context2K
Q4_K_M0.1 GB
QW
QwenPaw Flash 9B heretic MTP
Qwen · SC117
Params456M
Context256K
Q4_K_M5.8 GB