Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 1.5B Instruct
Qwen · lmstudio-community
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
qwen3 tts 1.7b voicedesign
Qwen · cstr
Params1.92B
Context—
Smallest2.0 GB
GGUF
HU
Hunyuan 0.5B Instruct
Hunyuan · bartowski
Params539M
Context256K
Q4_K_M0.4 GB
GGUF
GR
Granite 3.1 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
GE
Vikhr-Gemma-2B-instruct
Gemma · Vikhrmodels
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen3 Uncensored TextEncoders Klein Z Image Anima
Qwen · LuffyTheFox
Params596M
Context40K
Smallest1.2 GB
Coding
SE
SeedVR2
Seedvr · hk6668
Params3.39B
Context—
Q4_K_M2.0 GB
GGUF
LI
LightOnOCR 3 0.8B
Lightonocr · NANI-Nithin
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
OU
OuteTTS 0.2 500M
Outetts · OuteAI
Params500M
Context32K
Q4_K_M0.4 GB
GGUF
LL
Akikawa 3.3 1b Roleplay 128K
Llama · Green-Eye
Params1.24B
Context128K
Q4_K_M0.8 GB
Roleplay
GR
Granite 4.0 H 1b
Granite · ibm-granite
Params1.46B
Context1024K
Q4_K_M0.9 GB
GGUF
TE
NaviDC OCR
Teleocr · nandraj
Params752M
Context125K
Q4_K_M0.5 GB
Vision
DR
dreamshaper 8LCM im GGUF sdcpp
Dreamshaper · stduhpf
Params1.07B
Context—
Smallest1.5 GB
GGUF
IL
illustrious xl v2.0
Illustrious · off-grid-ai
Params3.47B
Context—
Smallest2.8 GB
GGUF
XL
xLAM 2 3b Fc R
Xlam · Salesforce
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · unsloth
Params1.54B
Context128K
Q4_K_M1.0 GB
Coding
SE
SEX_ROLEPLAY.v4 3.2 1B
Sex · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
RoleplayTool use
PY
Pythia 2.8b Deduped
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · lmstudio-community
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · DavidAU
Params3.21B
Context128K
Q4_K_M2.0 GB
Roleplay
GR
Granite 3b Code Instruct 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
HY
Hy MT2 1.8B 2Bit
tencent
Params1.79B
Context256K
Smallest0.6 GB
GGUF
QW
qwen3 tts 0.6b base
Qwen · cstr
Params915M
Context—
Smallest0.5 GB
GGUF
JI
jina embeddings v4 text matching
Jina · jinaai
Params3.1B
Context125K
Q4_K_M1.9 GB
Embedding
VO
voxcpm2
Voxcpm · cstr
Params2.38B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.5 abliterated MAX AIO
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
Vision
GR
Granite 3b Code Base 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
SM
SmolLM 135M
SmolLM · QuantFactory
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
QW
QwenPaw Flash 9B heretic MTP
Qwen · SC117
Params456M
Context256K
Q4_K_M5.8 GB
Tool useVision

Other sizes

Keep browsing