Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
JI
Jina Embeddings v5 Text Nano Retrieval
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
CodingEmbedding
MI
Ministral 3 3B Instruct 2512
Mistral · mistralai
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
QW
Qwen3.5 2B
Qwen · bartowski
Params1.94B
Context256K
Q4_K_M1.4 GB
Vision
JI
Jina Embeddings v5 Text Small Retrieval
Jina · jinaai
Params596M
Context40K
Q4_K_M0.4 GB
Embedding
QW
Qwen3 1.7B
Qwen · bartowski
Params2.03B
Context32K
Q4_K_M1.3 GB
GGUF
GL
gliner2 base v1
Gliner · antflydb
Params184M
Context—
Smallest0.0 GB
GGUF
LF
LFM2.5 2.6B DSpark Draft v1
Lfm · LiquidAI
Params328M
Context125K
Q4_K_M0.2 GB
GGUF
QW
Qwen3 0.6B
Qwen · ggml-org
Params752M
Context40K
Smallest0.4 GB
GGUF
MI
MiniCPM5 1B
MiniCPM · openbmb
Params1.08B
Context128K
Q4_K_M0.7 GB
Tool use
GR
ibm granite granite 20b code base
Granite · RichardErkhov
Params1.9B
Context—
Q4_K_M0.0 GB
Coding
LL
CreativeWriter Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
QW
qwen3 tts 0.6b customvoice
Qwen · cstr
Params906M
Context—
Smallest1.0 GB
GGUF
LL
Models Meta Llama Llama 3.2 1B Instruct
Llama · MaziyarPanahi
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
BS
BSRoformer-anvuew
Bsroformer · chenmozhijin
Params51M
Context—
Smallest0.0 GB
GGUF
MU
multitalker parakeet streaming 0.6b v1
Multitalker · handy-computer
Params740M
Context—
Q4_K_M0.6 GB
GGUF
DG
dgpl experimental 1
Dgpl · dgpl
Params550M
Context—
Q4_K_M0.3 GB
Reasoning
QW
Qwen_Qwen3.5 2B
Qwen · lmstudio-community
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
LL
Models Meta Llama Llama 3.2 3B Instruct
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
OM
OmniVoice-tokenizer
Omnivoice · Serveurperso
Params613M
Context—
Q4_K_M0.3 GB
GGUF
GE
Winnow E4B
Gemma · EldanRing
Params78M
Context128K
Smallest0.2 GB
Vision
GL
GLM OCR
GLM · ggml-org
Params891M
Context128K
Smallest1.0 GB
Vision
GR
Granite Speech 4.1 2B NAR
Granite · handy-computer
Params2.25B
Context—
Q4_K_M1.6 GB
GGUF
LL
Llama-3.2-1B-Instruct
Llama · unsloth
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
D1
d1 3B
LiquidAI
Params2.7B
Context32K
Q4_K_M1.7 GB
Vision
QW
Models Qwen Qwen2.5 1.5B Instruct
Qwen · MaziyarPanahi
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
CO
Models 01 Ai Yi Coder 1.5B Chat
Coder · MaziyarPanahi
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
SE
SeedVR2
Seedvr · cmeka
Params3.39B
Context—
Q4_K_M2.0 GB
GGUF
MI
Models Mistralai Ministral 3 3B Reasoning 2512
Mistral · MaziyarPanahi
Params3.43B
Context256K
Q4_K_M2.1 GB
Reasoning
GE
Models Google Gemma 2 2b It
Gemma · MaziyarPanahi
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen2 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use

Other sizes

Keep browsing