Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
JI
Jina Embeddings v5 Text Nano Retrieval
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
MI
Ministral 3 3B Instruct 2512
Mistral · mistralai
Params3.43B
Context256K
Q4_K_M2.1 GB
QW
Qwen3.5 2B
Qwen · bartowski
Params1.94B
Context256K
Q4_K_M1.4 GB
JI
Jina Embeddings v5 Text Small Retrieval
Jina · jinaai
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3 1.7B
Qwen · bartowski
Params2.03B
Context32K
Q4_K_M1.3 GB
GL
gliner2 base v1
Gliner · antflydb
Params184M
Context—
Smallest0.0 GB
LF
LFM2.5 2.6B DSpark Draft v1
Lfm · LiquidAI
Params328M
Context125K
Q4_K_M0.2 GB
QW
Qwen3 0.6B
Qwen · ggml-org
Params752M
Context40K
Smallest0.4 GB
MI
MiniCPM5 1B
MiniCPM · openbmb
Params1.08B
Context128K
Q4_K_M0.7 GB
GR
ibm granite granite 20b code base
Granite · RichardErkhov
Params1.9B
Context—
Q4_K_M0.0 GB
LL
CreativeWriter Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
qwen3 tts 0.6b customvoice
Qwen · cstr
Params906M
Context—
Smallest1.0 GB
LL
Models Meta Llama Llama 3.2 1B Instruct
Llama · MaziyarPanahi
Params1.24B
Context128K
Q4_K_M0.8 GB
BS
BSRoformer-anvuew
Bsroformer · chenmozhijin
Params51M
Context—
Smallest0.0 GB
MU
multitalker parakeet streaming 0.6b v1
Multitalker · handy-computer
Params740M
Context—
Q4_K_M0.6 GB
DG
dgpl experimental 1
Dgpl · dgpl
Params550M
Context—
Q4_K_M0.3 GB
QW
Qwen_Qwen3.5 2B
Qwen · lmstudio-community
Params1.88B
Context256K
Q4_K_M1.3 GB
LL
Models Meta Llama Llama 3.2 3B Instruct
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
OM
OmniVoice-tokenizer
Omnivoice · Serveurperso
Params613M
Context—
Q4_K_M0.3 GB
GE
Winnow E4B
Gemma · EldanRing
Params78M
Context128K
Smallest0.2 GB
GL
GLM OCR
GLM · ggml-org
Params891M
Context128K
Smallest1.0 GB
GR
Granite Speech 4.1 2B NAR
Granite · handy-computer
Params2.25B
Context—
Q4_K_M1.6 GB
LL
Llama-3.2-1B-Instruct
Llama · unsloth
Params1.24B
Context128K
Q4_K_M0.8 GB
D1
d1 3B
LiquidAI
Params2.7B
Context32K
Q4_K_M1.7 GB
QW
Models Qwen Qwen2.5 1.5B Instruct
Qwen · MaziyarPanahi
Params1.54B
Context32K
Q4_K_M1.0 GB
CO
Models 01 Ai Yi Coder 1.5B Chat
Coder · MaziyarPanahi
Params1.48B
Context128K
Q4_K_M1.0 GB
SE
SeedVR2
Seedvr · cmeka
Params3.39B
Context—
Q4_K_M2.0 GB
MI
Models Mistralai Ministral 3 3B Reasoning 2512
Mistral · MaziyarPanahi
Params3.43B
Context256K
Q4_K_M2.1 GB
GE
Models Google Gemma 2 2b It
Gemma · MaziyarPanahi
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen2 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB