Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B ASCII Condensed
Qwen · troed
Params1.86B
Context256K
Smallest0.5 GB
GGUF
QW
Qwen3 ASR 1.7B Uncensored
Qwen · mradermacher
Params2.03B
Context64K
Q4_K_M1.3 GB
Vision
MI
MiniCPM V 4.7 35B A3B DSpark
MiniCPM · magnitudedev
Params389M
Context256K
Smallest0.4 GB
ReasoningTool useVision
SA
Sarashina2.2 0.5b
Sarashina · mradermacher
Params793M
Context8K
Q4_K_M0.5 GB
GGUF
QW
QwenPaw Flash 9B
Qwen · SC117
Params456M
Context256K
Q4_K_M5.8 GB
Tool useVision
JA
Jan v1 edge
Jan · janhq
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
LL
Reasoning Llama 1b v0.1
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
Reasoning
QW
Replete-Coder-Qwen2-1.5b
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingTool use
GR
docling
Granite · gguf-org
Params258M
Context—
Q4_K_M0.5 GB
GGUF
LA
ecapa lid 107
Lang · cstr
Params21M
Context—
Smallest0.0 GB
GGUF
RU
ruvltra claude code
Ruvltra · ruv
Params494M
Context32K
Q4_K_M0.4 GB
Coding
DE
dxa guard deepseek r1 1.5b
DeepSeek · mosetireagan
Params1.78B
Context128K
Smallest1.1 GB
ReasoningTool use
LL
OneLLM Doey ChatQA V1 Llama 3.2 1B
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
QW
Magos K8S 0.6b
Qwen · clglavan
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
QW
Qwen3 Embedding 0.6B
Qwen · moeshawky
Params596M
Context32K
Smallest0.6 GB
CodingEmbeddingReasoning
QW
Qwen3.5 2B Uncensored Abliterix SOM
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningRoleplayTool use
QW
qwen35 2b muesli cleanup v12
Qwen · Muesli-HQ
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
GR
Granite 3.2 2b Instruct
Granite · ibm-research
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GL
GLM 4.5 DRAFT 0.6B v3.0
GLM · mradermacher
Params629M
Context32K
Q4_K_M0.5 GB
GGUF
QW
Qwen3 VisionCaption 2B It REDACTED
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
Tool useVision
LU
Menlo Lucy
Lucy · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · LxBarn
Params1.86B
Context256K
Smallest0.9 GB
GGUF
CY
Cypher CoT 1.8B i1
Cypher · mradermacher
Params1.83B
Context16K
Q4_K_M1.1 GB
Coding
QW
Qwen2.5 3B Instruct
Qwen · second-state
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
Qwen2.5 Coder 3B Uncensored
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
ST
starcoder2 3b instruct
StarCoder · QuantFactory
Params3.03B
Context16K
Q4_K_M1.9 GB
Coding
QW
nanohat qwen3 0.6b final
Qwen · blackpirates
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
LF
LFM3 Omni 2B
Lfm · erenyeager-1
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
FA
Falcon H1 3B Instruct
Falcon · tiiuae
Params3.15B
Context128K
Q4_K_M1.9 GB
GGUF
PU
public poetry 50m
Public · wildfellhall
Params47M
Context1K
Smallest0.1 GB
GGUF

Other sizes

Keep browsing