Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
FA
face detect
Face · mudler
Params70M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 1.7B
Qwen · lmstudio-community
Params2.03B
Context32K
Q4_K_M1.3 GB
GGUF
GE
Gemma 3 1b It
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
PI
PII Tracer
Pii · perplexity-ai
Params596M
Context32K
Smallest1.2 GB
GGUF
KI
Kimodo-SOMA-RP-v1.1
Kimodo · LocalAI-io
Params283M
Context—
Smallest1.1 GB
GGUF
UN
Unlimited OCR
Unlimited · sahilchachra
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
MI
MiniCPM OCR 1.0
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen3 Zero Coder Reasoning V2 0.8B NEO EX
Qwen · DavidAU
Params816M
Context40K
Q4_K_M0.5 GB
CodingReasoning
GR
Granite Embedding 107m Multilingual
Granite · bartowski
Params107M
Context512
Q4_K_M0.1 GB
Embedding
QW
NasledieLab Qwen3.5 0.8B GPT 6 Astra Luna Fable 5.1 Opus 5.5 distill Karpy
Qwen · aemmeath
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
GR
Granite-4.1-3B
Granite · weareapexcreators
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
NO
nomic-embed-text-v1
Nomic · nomic-ai
Params137M
Context2K
Q4_K_M0.1 GB
Embedding
LF
LFM2 2.6B
Lfm · LiquidAI
Params2.57B
Context125K
Q4_K_M1.6 GB
GGUF
QW
qwen2-1_5b-instruct
Qwen · Qwen
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · bartowski
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
DE
deepseek-ai_deepseek-coder-1.3b-instruct
DeepSeek · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
MI
MinerU2.5 Pro 2605 1.2B
Mineru · jinzhenj
Params494M
Context8K
Smallest0.5 GB
Vision
QW
speakoflow mini
Qwen · SpeakoFlow
Params773M
Context256K
Q4_K_M0.5 GB
GGUF
QW
Qwen2.5 3B Instruct Abliterated
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M1.9 GB
GGUF
UN
Undi95 Emerhyst 20B
Undi · RichardErkhov
Params920M
Context—
Q4_K_M0.0 GB
GGUF
WH
whisper large v3 turbo
Whisper · xkeyC
Params809M
Context—
Smallest0.5 GB
GGUF
BG
bge-small-zh-v1.5
BGE · CompendiumLabs
Params24M
Context512
Q4_K_M0.0 GB
Embedding
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · mrfakename
Params1M
Context—
Q4_K_M444.7 GB
GGUF
NE
privacy-filter-nemotron
Nemotron · LocalAI-io
Params1.4B
Context128K
Smallest1.6 GB
GGUF
MI
MiniCPM V 4.7 1B DSpark
MiniCPM · openbmb
Params214M
Context256K
Q4_K_M0.1 GB
Tool useVision
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · huihui-ai
Params1.68B
Context1024K
Smallest0.6 GB
GGUF
HO
K2 Horizon 0.9B
Horizon · IFM
Params1.08B
Context128K
Q4_K_M0.7 GB
Reasoning
WA
Wan2.1 T2V 1.3B
Wan · samuelchristlie
Params1.42B
Context—
Q4_K_M1.0 GB
GGUF
GR
granite 4.0 1b speech
Granite · handy-computer
Params2.31B
Context—
Q4_K_M1.6 GB
GGUF
OR
Ornith 1.5 35B A3B Heretic MTP APEX
Ornith · SC117
Params447M
Context256K
Smallest14.3 GB
ReasoningVision

Other sizes

Keep browsing