Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
Mage VL
Mage · JohnTdi
Params21M
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen2.5.1 Coder 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Qwen3.6 35B A3B DFlash
Qwen · magnitudedev
Params386M
Context40K
Smallest0.4 GB
GGUF
MI
MiniCPM5 2B Claude Fable5 heretic
MiniCPM · saidutta69
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
QW
Qwen3 TTS 12Hz 0.6B Base
Qwen · mradermacher
Params600M
Context32K
Q4_K_M0.4 GB
Vision
QW
Qwen3.8 2B
Qwen · piskle
Params1.94B
Context256K
Q4_K_M1.3 GB
GGUF
QW
Qwen3.5 0.8B Japanese SFT v2
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
QW
Qwen2.5 Coder 3B Uncensored
Qwen · bappi
Params3.1B
Context32K
Q4_K_M1.9 GB
Coding
SM
SmolLM2 135M Instruct
SmolLM · lmstudio-community
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
GR
Granite 4.0 H 1B BE
Granite · taronaeo
Params1.46B
Context—
Q4_K_M0.9 GB
GGUF
JA
AI21 Jamba Reasoning 3B
Jamba · bartowski
Params3.2B
Context256K
Q4_K_M1.9 GB
Reasoning
RO
rocket 3B
Rocket · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
JI
Jina Reranker v3.5
Jina · jinaai
Params596M
Context128K
Q4_K_M0.4 GB
Embedding
QW
Qwen3.5 4B DFlash
Qwen · magnitudedev
Params634M
Context40K
Smallest0.7 GB
GGUF
MI
Ministral-3-3B-Reasoning-2512
Mistral · Mungert
Params3.43B
Context256K
Q4_K_M2.2 GB
Reasoning
FL
FLUX.1 dev
Flux · second-state
Params123M
Context—
Smallest0.1 GB
GGUF
AN
Anima base v1.0
Anima · Abiray
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF
SM
KrynexAI 1.4
SmolLM · KrynexLabs
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
DR
dreamshaper8 lcm
Dreamshaper · haven-ai-companion
Params1.07B
Context—
Smallest1.6 GB
GGUF
LF
LFM2 VL 450M
Lfm · LiquidAI
Params354M
Context125K
Smallest0.2 GB
Vision
IR
Sakura Iris 3B Uncensored
Iris · webmp3
Params2.99B
Context—
Q4_K_M3.4 GB
GGUF
PY
Pythia 2.8b
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
SH
Shieldgemma 2b
Shieldgemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
GGUF
QW
dolphin-2.9.3-qwen2-1.5b
Qwen · crusoeai
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
SM
nisten/Biggie-SmoLlm-0.15B-Base
SmolLM · nisten
Params152M
Context2K
Smallest0.2 GB
GGUF
SD
SDXL Lightning
Sdxl · mzwing
Params3.47B
Context—
Smallest2.6 GB
GGUF
QW
Qwen2.5 Coder 0.5B Instruct Abliterated
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Coding
GE
Gemma 3 270m It
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
AN
Anima
Anima · Bedovyy
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF
GR
granite-3b-code-base
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding

Other sizes

Keep browsing