Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 0.6B
Qwen · bartowski
Params752M
Context32K
Q4_K_M0.5 GB
GGUF
NE
.nemotron-speech-streaming-en-0.6b.q8_0.gguf
Nemotron · nvidia
Params628M
Context—
Smallest0.7 GB
GGUF
EM
embeddinggemma-2
Embeddinggemma · ggml-org
Params271M
Context256K
Smallest0.3 GB
EmbeddingVision
SU
Supra2 100M Instruct
Supra · SupraLabs
Params101M
Context2K
Smallest0.2 GB
GGUF
DE
Deepseek-R1-Distill-Qwen-1.5B
DeepSeek · unsloth
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
QW
nl2sh 1.5b Q4 K M
Qwen · ThorOdinson246
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Qwen3.5 0.8B Artemis
Qwen · turintech
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
LF
LFM2.5-350M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
CA
Canary 1B v2
Canary · handy-computer
Params980M
Context—
Q4_K_M0.7 GB
GGUF
GE
gemma 2b
Gemma · google
Params2.51B
Context—
Smallest10.0 GB
GGUF
GE
Gemma 3 1b It
Gemma · lmstudio-community
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
BO
Bonsai-1.7B
Bonsai · prism-ml
Params1.72B
Context32K
Smallest0.2 GB
GGUF
PA
PaddleOCR VL 1.6
Paddleocr · PaddlePaddle
Params467M
Context128K
Smallest0.9 GB
Vision
QW
Qwen3-Vl-2B-Instruct
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
QW
Qwen2.5 Coder 3B Instruct AWQ
Qwen · Qwen
Params3.4B
Context32K
Q4_K_M2.1 GB
Coding
GE
Gemma-3-270M-It
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
VI
VibeVoice ASR Streaming 1.5B
Vibevoice · christopherthompson81
Params3.1B
Context—
Smallest2.1 GB
GGUF
QW
Qwen2.5 Omni 3B
Qwen · ggml-org
Params3.4B
Context32K
Q4_K_M2.1 GB
Vision
NE
Nemotron 3 Embed 1B Q4 K M
Nemotron · zenmagnets
Params1.14B
Context256K
Q4_K_M0.7 GB
Embedding
GE
gemma 4 31B it qat
Gemma · unsloth
Params480M
Context128K
Smallest0.3 GB
Vision
GR
Granite 4.0 1B BE
Granite · taronaeo
Params1.63B
Context—
Q4_K_M1.0 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
qmd query expansion 1.7B
Qwen · tobil
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
SO
sopro v2 turbo
Sopro · samuel-vitorino
Params158M
Context—
Smallest0.3 GB
GGUF
VI
VibeVoice ASR BitNet
Vibevoice · microsoft
Params1.78B
Context—
Smallest0.7 GB
GGUF
TI
tinygemma3
Tinygemma · ggml-org
Params38M
Context128K
Smallest0.0 GB
Vision
PH
phonon 31m en
Phonon · gradium
Params41M
Context—
Smallest0.1 GB
GGUF
GI
GigaAM v3 E2E-RNN-T
Gigaam · handy-computer
Params223M
Context—
Q4_K_M0.2 GB
GGUF
QW
Models Qwen Qwen3 0.6B
Qwen · MaziyarPanahi
Params752M
Context40K
Q4_K_M0.5 GB
GGUF

Other sizes

Keep browsing