Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP GGUF Q8 NVFP4
Qwen · AIconjured
Params1.86B
Context—
Smallest0.9 GB
GGUF
OP
Q36 35B A3B Opus4.7 Ablit Heretic OBLITERATUS Hermes MTP Vision Ollama
Opus · oktayd
Params447M
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
LF
LFM2.5 1.2B Thinking heretic
Lfm · saidutta69
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
MA
Mamba 1.4b Hf
Mamba · mradermacher
Params1.37B
Context1024K
Q4_K_M0.8 GB
GGUF
HA
Hare1.0 Beta
Hare · mradermacher
Params1.19B
Context32K
Q4_K_M0.7 GB
GGUF
QW
Qwen2-0.5B
Qwen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
CO
Cosmic Lightning
Cosmic · bartowski
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
JA
AI21-Jamba-Reasoning-3B
Jamba · Mungert
Params3.2B
Context256K
Q4_K_M2.0 GB
ReasoningTool use
QW
Qwen3 1.7B
Qwen · second-state
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
LF
LFM2 1.2B Hi Fi
Lfm · fraQtl
Params1.17B
Context125K
Smallest0.7 GB
Tool use
PO
pocket tts
Pocket · EryriLabs
Params80M
Context4K
Smallest0.2 GB
Vision
GE
Gemma 3 1b It
Gemma · DavidAU
Params1B
Context32K
Q4_K_M1.1 GB
GGUF
HA
Hare 1.1B Base 0.5v
Hare · mradermacher
Params1.19B
Context32K
Q4_K_M0.7 GB
GGUF
LF
Claude
Lfm · FlameF0X
Params1.17B
Context125K
Q4_K_M0.7 GB
Reasoning
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · hardcoremoore
Params1.86B
Context—
Smallest0.9 GB
GGUF
RW
RWKV 5.2 3B NSFW Role 16k
Rwkv · mzwing
Params3.1B
Context1024K
Q4_K_M1.9 GB
GGUF
QW
MangaExpert OCR Qwen3.5 2b 20260820 185447
Qwen · The1Just
Params1.88B
Context256K
Smallest2.0 GB
Vision
SM
SmolLM3 3B heretic
SmolLM · saidutta69
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningRoleplayTool use
BA
bark-small
Bark · cstr
Params404M
Context—
Smallest0.2 GB
GGUF
ST
StartLux Decision v1 2B Q4 K M
Startlux · startlux-models
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
QW
Qwen2.5-0.5B-Instruct
Qwen · Mungert
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
SQ
SQLFlow Retrival 0.6B
Sqlflow · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen3 1.7B Q4 K M
Qwen · marcoalberto
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
LL
Llama Sentient 3.2 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
GR
Granite 3.3 2b Instruct
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GE
Gemma 4 E2B It Qat Assistant
Gemma · Yiriru
Params77M
Context128K
Smallest0.1 GB
ReasoningTool useVision
NO
Nova-v3
Nova · plasmova
Params170M
Context2K
Smallest0.3 GB
Coding
CA
CAT Translate 1.4b
Cat · mmnga-o
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
WA
wav2vec2 large xlsr 53 chinese zh cn
Wav · cstr
Params319M
Context—
Smallest0.2 GB
GGUF
QW
gte-Qwen2-1.5B-instruct
Qwen · second-state
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingEmbedding

Other sizes

Keep browsing