Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP GGUF Q8 NVFP4
Qwen · AIconjured
Params1.86B
Context—
Smallest0.9 GB
OP
Q36 35B A3B Opus4.7 Ablit Heretic OBLITERATUS Hermes MTP Vision Ollama
Opus · oktayd
Params447M
Context256K
Q4_K_M21.7 GB
LF
LFM2.5 1.2B Thinking heretic
Lfm · saidutta69
Params1.17B
Context125K
Q4_K_M0.7 GB
MA
Mamba 1.4b Hf
Mamba · mradermacher
Params1.37B
Context1024K
Q4_K_M0.8 GB
HA
Hare1.0 Beta
Hare · mradermacher
Params1.19B
Context32K
Q4_K_M0.7 GB
QW
Qwen2-0.5B
Qwen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
CO
Cosmic Lightning
Cosmic · bartowski
Params1.73B
Context256K
Q4_K_M1.1 GB
JA
AI21-Jamba-Reasoning-3B
Jamba · Mungert
Params3.2B
Context256K
Q4_K_M2.0 GB
QW
Qwen3 1.7B
Qwen · second-state
Params2.03B
Context40K
Q4_K_M1.3 GB
LF
LFM2 1.2B Hi Fi
Lfm · fraQtl
Params1.17B
Context125K
Smallest0.7 GB
PO
pocket tts
Pocket · EryriLabs
Params80M
Context4K
Smallest0.2 GB
GE
Gemma 3 1b It
Gemma · DavidAU
Params1B
Context32K
Q4_K_M1.1 GB
HA
Hare 1.1B Base 0.5v
Hare · mradermacher
Params1.19B
Context32K
Q4_K_M0.7 GB
LF
Claude
Lfm · FlameF0X
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · hardcoremoore
Params1.86B
Context—
Smallest0.9 GB
RW
RWKV 5.2 3B NSFW Role 16k
Rwkv · mzwing
Params3.1B
Context1024K
Q4_K_M1.9 GB
QW
MangaExpert OCR Qwen3.5 2b 20260820 185447
Qwen · The1Just
Params1.88B
Context256K
Smallest2.0 GB
SM
SmolLM3 3B heretic
SmolLM · saidutta69
Params3.08B
Context64K
Q4_K_M1.9 GB
BA
bark-small
Bark · cstr
Params404M
Context—
Smallest0.2 GB
ST
StartLux Decision v1 2B Q4 K M
Startlux · startlux-models
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen2.5-0.5B-Instruct
Qwen · Mungert
Params494M
Context32K
Q4_K_M0.4 GB
SQ
SQLFlow Retrival 0.6B
Sqlflow · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
QW
Qwen3 1.7B Q4 K M
Qwen · marcoalberto
Params2.03B
Context40K
Q4_K_M1.3 GB
LL
Llama Sentient 3.2 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GR
Granite 3.3 2b Instruct
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GE
Gemma 4 E2B It Qat Assistant
Gemma · Yiriru
Params77M
Context128K
Smallest0.1 GB
NO
Nova-v3
Nova · plasmova
Params170M
Context2K
Smallest0.3 GB
CA
CAT Translate 1.4b
Cat · mmnga-o
Params1.41B
Context8K
Q4_K_M0.9 GB
WA
wav2vec2 large xlsr 53 chinese zh cn
Wav · cstr
Params319M
Context—
Smallest0.2 GB
QW
gte-Qwen2-1.5B-instruct
Qwen · second-state
Params1.78B
Context128K
Q4_K_M1.1 GB