Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Qwen3.8 27B ASCII Condensed
Qwen · troed
Params1.86B
Context256K
Smallest0.5 GB
QW
Qwen3 ASR 1.7B Uncensored
Qwen · mradermacher
Params2.03B
Context64K
Q4_K_M1.3 GB
MI
MiniCPM V 4.7 35B A3B DSpark
MiniCPM · magnitudedev
Params389M
Context256K
Smallest0.4 GB
SA
Sarashina2.2 0.5b
Sarashina · mradermacher
Params793M
Context8K
Q4_K_M0.5 GB
QW
QwenPaw Flash 9B
Qwen · SC117
Params456M
Context256K
Q4_K_M5.8 GB
JA
Jan v1 edge
Jan · janhq
Params1.72B
Context40K
Q4_K_M1.1 GB
LL
Reasoning Llama 1b v0.1
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Replete-Coder-Qwen2-1.5b
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
GR
docling
Granite · gguf-org
Params258M
Context—
Q4_K_M0.5 GB
LA
ecapa lid 107
Lang · cstr
Params21M
Context—
Smallest0.0 GB
RU
ruvltra claude code
Ruvltra · ruv
Params494M
Context32K
Q4_K_M0.4 GB
DE
dxa guard deepseek r1 1.5b
DeepSeek · mosetireagan
Params1.78B
Context128K
Smallest1.1 GB
LL
OneLLM Doey ChatQA V1 Llama 3.2 1B
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Magos K8S 0.6b
Qwen · clglavan
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3 Embedding 0.6B
Qwen · moeshawky
Params596M
Context32K
Smallest0.6 GB
QW
Qwen3.5 2B Uncensored Abliterix SOM
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
qwen35 2b muesli cleanup v12
Qwen · Muesli-HQ
Params1.88B
Context256K
Q4_K_M1.3 GB
GR
Granite 3.2 2b Instruct
Granite · ibm-research
Params2.53B
Context128K
Q4_K_M1.5 GB
GL
GLM 4.5 DRAFT 0.6B v3.0
GLM · mradermacher
Params629M
Context32K
Q4_K_M0.5 GB
QW
Qwen3 VisionCaption 2B It REDACTED
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
LU
Menlo Lucy
Lucy · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · LxBarn
Params1.86B
Context256K
Smallest0.9 GB
CY
Cypher CoT 1.8B i1
Cypher · mradermacher
Params1.83B
Context16K
Q4_K_M1.1 GB
QW
Qwen2.5 3B Instruct
Qwen · second-state
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2.5 Coder 3B Uncensored
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
ST
starcoder2 3b instruct
StarCoder · QuantFactory
Params3.03B
Context16K
Q4_K_M1.9 GB
QW
nanohat qwen3 0.6b final
Qwen · blackpirates
Params596M
Context40K
Q4_K_M0.4 GB
LF
LFM3 Omni 2B
Lfm · erenyeager-1
Params1.73B
Context125K
Q4_K_M1.1 GB
FA
Falcon H1 3B Instruct
Falcon · tiiuae
Params3.15B
Context128K
Q4_K_M1.9 GB
PU
public poetry 50m
Public · wildfellhall
Params47M
Context1K
Smallest0.1 GB