Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
FA
face detect
Face · mudler
Params70M
Context—
Smallest0.0 GB
QW
Qwen3 1.7B
Qwen · lmstudio-community
Params2.03B
Context32K
Q4_K_M1.3 GB
GE
Gemma 3 1b It
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
PI
PII Tracer
Pii · perplexity-ai
Params596M
Context32K
Smallest1.2 GB
KI
Kimodo-SOMA-RP-v1.1
Kimodo · LocalAI-io
Params283M
Context—
Smallest1.1 GB
UN
Unlimited OCR
Unlimited · sahilchachra
Params2.93B
Context—
Q4_K_M2.0 GB
MI
MiniCPM OCR 1.0
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3 Zero Coder Reasoning V2 0.8B NEO EX
Qwen · DavidAU
Params816M
Context40K
Q4_K_M0.5 GB
GR
Granite Embedding 107m Multilingual
Granite · bartowski
Params107M
Context512
Q4_K_M0.1 GB
QW
NasledieLab Qwen3.5 0.8B GPT 6 Astra Luna Fable 5.1 Opus 5.5 distill Karpy
Qwen · aemmeath
Params752M
Context256K
Q4_K_M0.5 GB
GR
Granite-4.1-3B
Granite · weareapexcreators
Params3.4B
Context128K
Q4_K_M2.1 GB
NO
nomic-embed-text-v1
Nomic · nomic-ai
Params137M
Context2K
Q4_K_M0.1 GB
LF
LFM2 2.6B
Lfm · LiquidAI
Params2.57B
Context125K
Q4_K_M1.6 GB
QW
qwen2-1_5b-instruct
Qwen · Qwen
Params1.54B
Context32K
Q4_K_M1.0 GB
SM
SmolLM2 1.7B Instruct
SmolLM · bartowski
Params1.71B
Context8K
Q4_K_M1.1 GB
DE
deepseek-ai_deepseek-coder-1.3b-instruct
DeepSeek · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB
MI
MinerU2.5 Pro 2605 1.2B
Mineru · jinzhenj
Params494M
Context8K
Smallest0.5 GB
QW
speakoflow mini
Qwen · SpeakoFlow
Params773M
Context256K
Q4_K_M0.5 GB
QW
Qwen2.5 3B Instruct Abliterated
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M1.9 GB
UN
Undi95 Emerhyst 20B
Undi · RichardErkhov
Params920M
Context—
Q4_K_M0.0 GB
WH
whisper large v3 turbo
Whisper · xkeyC
Params809M
Context—
Smallest0.5 GB
BG
bge-small-zh-v1.5
BGE · CompendiumLabs
Params24M
Context512
Q4_K_M0.0 GB
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · mrfakename
Params1M
Context—
Q4_K_M444.7 GB
NE
privacy-filter-nemotron
Nemotron · LocalAI-io
Params1.4B
Context128K
Smallest1.6 GB
MI
MiniCPM V 4.7 1B DSpark
MiniCPM · openbmb
Params214M
Context256K
Q4_K_M0.1 GB
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · huihui-ai
Params1.68B
Context1024K
Smallest0.6 GB
HO
K2 Horizon 0.9B
Horizon · IFM
Params1.08B
Context128K
Q4_K_M0.7 GB
WA
Wan2.1 T2V 1.3B
Wan · samuelchristlie
Params1.42B
Context—
Q4_K_M1.0 GB
GR
granite 4.0 1b speech
Granite · handy-computer
Params2.31B
Context—
Q4_K_M1.6 GB
OR
Ornith 1.5 35B A3B Heretic MTP APEX
Ornith · SC117
Params447M
Context256K
Smallest14.3 GB