Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
GE
Octopus-v2
Gemma · NexaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
Qwen3 Embedding 0.6B
Qwen · PeterAM4
Params596M
Context32K
Q4_K_M0.4 GB
QW
Qwen2 0.5B NuminaMath TIR v1
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
ST
stabilityai japanese stablelm base beta 70b
Stabilityai · RichardErkhov
Params1.6B
Context—
Q4_K_M0.0 GB
GL
GLM-ASR-Nano
GLM · cstr
Params2.26B
Context—
Smallest1.3 GB
QW
Qwen3.5 2B
Qwen · SoAIHQ
Params1.94B
Context256K
Q4_K_M1.3 GB
QW
dnotitia_Smoothie Qwen3 0.6B
Qwen · Alcoft
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · unsloth
Params1.54B
Context32K
Q4_K_M1.0 GB
GR
Granite-4.0-Micro
Granite · unsloth
Params3.4B
Context128K
Q4_K_M2.1 GB
LL
OneLLM Doey V1 Llama 3.2 1B It
Llama · DoeyLLM
Params1.24B
Context128K
Smallest1.3 GB
QW
Qwen3 VL 2B Instruct heretic
Qwen · saidutta69
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen3 0.9B A0.6B
Qwen · mradermacher
Params860M
Context40K
Q4_K_M0.6 GB
SM
SmolLM 360M
SmolLM · Felladrin
Params362M
Context2K
Smallest0.2 GB
LL
OneLLM Doey V1 Llama 3.2 3B Q4 K M
Llama · DoeyLLM
Params3.21B
Context128K
Q4_K_M2.0 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
OneLLM Doey ChatQA V1 Llama 3.2 1B
Llama · DoeyLLM
Params1.24B
Context128K
Smallest1.3 GB
QW
Qwen2.5 1.5b Uncensored
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
MA
magpie tts.cpp
Magpie · mudler
Params347M
Context—
Smallest0.5 GB
LF
LFM2 350M ENJP MT
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
TI
py007_tinyllama-1.1b-python-v0.1
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen2.5 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GE
NVIDIA GEM-X SOMA regression denoiser
Gem · LocalAI-io
Params44M
Context120
Smallest0.2 GB
MI
Mistral Small 3.1 DRAFT 0.5B
Mistral · bartowski
Params593M
Context32K
Q4_K_M0.5 GB
QW
Qwen2-0.5B-Instruct
Qwen · legraphista
Params494M
Context32K
Smallest0.3 GB
QW
Qwen2.5 Coder 3B
Qwen · ggml-org
Params3.09B
Context32K
Smallest3.3 GB
GR
Granite-4.0-H-1B
Granite · unsloth
Params1.46B
Context1024K
Q4_K_M0.9 GB
ST
stable-code-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
GP
Gpt2 Medium
Gpt · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
GE
google gemma 2b it
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
PL
Plamo 3 Nict 2b Base
Plamo · mmnga-o
Params2.6B
Context4K
Q4_K_M1.7 GB