Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
MU
multilingual e5 small
Multilingual · TwinSunsLLC
Params118M
Context511
Smallest0.1 GB
Embedding
NA
Nanonets OCR2 3B
Nanonets · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
LL
Meta Llama Llama 3.2 3B Instruct Heretic Nosyco
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
IN
Index Nailong 2B
Index · IndexTeam
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
CS
Csg Wukong 1B
Csg · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
QW
Replete LLM V2.5 Qwen 0.5b
Qwen · bartowski
Params630M
Context32K
Q4_K_M0.5 GB
GGUF
WH
whisper base
Whisper · oxide-lab
Params73M
Context—
Smallest0.0 GB
GGUF
SE
Selene 3B Instruct
Selene · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
LL
Dolphin 3.0 Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
LF
LFM3 1.7B Frontier SmartAgent
Lfm · mohommed
Params1.73B
Context512K
Q4_K_M1.1 GB
CodingReasoningTool use
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
JI
jina embeddings v2 base code Q8 0
Jina · ggml-org
Params160M
Context8K
Smallest0.2 GB
CodingEmbedding
QW
Mixture Summarizer Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
BO
Borealis 1b
Borealis · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3 270m
Gemma · gguf-org
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
NE
news title generator
News · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
GGUF
QW
Qwen3 1.7B heretic
Qwen · saidutta69
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
GL
glm ocr crispembed
GLM · cstr
Params1.11B
Context—
Smallest0.0 GB
GGUF
SM
SmolLM 135M GrammarSFT
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
RE
lb reranker 0.5B v1.0
Reranker · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Embedding
GI
gigaam v3
Gigaam · cstr
Params221M
Context—
Smallest0.2 GB
GGUF
QW
Qwen 3.5 0.8B Uncensored Conversational
Qwen · minas2025
Params752M
Context256K
Smallest0.8 GB
Vision
OP
OpenELM-1_1B-Instruct
Openelm · RichardErkhov
Params1.08B
Context2K
Q4_K_M0.7 GB
GGUF
GE
Gemma 4 E4B It Qat Assistant
Gemma · Yiriru
Params78M
Context128K
Smallest0.1 GB
ReasoningTool useVision
EV
EAN 3B i1
Evan · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
Reasoning
SM
SmolLM2 135M Instruct Q4 K M
SmolLM · jc-builds
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
DA
danube2-1.8b-openhermes
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
Tool use
GE
Gemma 4 E2B It Assistant
Gemma · AtomicChat
Params77M
Context128K
Q4_K_M0.1 GB
GGUF
NE
nexus coder
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
SA
Salt Asr_Wav Uni_1_Tts_Wav Uni_1 12k
Salt · RichardErkhov
Params3.23B
Context128K
Q4_K_M2.0 GB
GGUF

Other sizes

Keep browsing