Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
MU
multilingual e5 small
Multilingual · TwinSunsLLC
Params118M
Context511
Smallest0.1 GB
NA
Nanonets OCR2 3B
Nanonets · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
LL
Meta Llama Llama 3.2 3B Instruct Heretic Nosyco
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
IN
Index Nailong 2B
Index · IndexTeam
Params1.88B
Context256K
Q4_K_M1.3 GB
CS
Csg Wukong 1B
Csg · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Replete LLM V2.5 Qwen 0.5b
Qwen · bartowski
Params630M
Context32K
Q4_K_M0.5 GB
WH
whisper base
Whisper · oxide-lab
Params73M
Context—
Smallest0.0 GB
SE
Selene 3B Instruct
Selene · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
LL
Dolphin 3.0 Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LF
LFM3 1.7B Frontier SmartAgent
Lfm · mohommed
Params1.73B
Context512K
Q4_K_M1.1 GB
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
JI
jina embeddings v2 base code Q8 0
Jina · ggml-org
Params160M
Context8K
Smallest0.2 GB
QW
Mixture Summarizer Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
BO
Borealis 1b
Borealis · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 270m
Gemma · gguf-org
Params268M
Context32K
Q4_K_M0.3 GB
NE
news title generator
News · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
QW
Qwen3 1.7B heretic
Qwen · saidutta69
Params1.72B
Context40K
Q4_K_M1.1 GB
GL
glm ocr crispembed
GLM · cstr
Params1.11B
Context—
Smallest0.0 GB
SM
SmolLM 135M GrammarSFT
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
RE
lb reranker 0.5B v1.0
Reranker · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
GI
gigaam v3
Gigaam · cstr
Params221M
Context—
Smallest0.2 GB
QW
Qwen 3.5 0.8B Uncensored Conversational
Qwen · minas2025
Params752M
Context256K
Smallest0.8 GB
OP
OpenELM-1_1B-Instruct
Openelm · RichardErkhov
Params1.08B
Context2K
Q4_K_M0.7 GB
GE
Gemma 4 E4B It Qat Assistant
Gemma · Yiriru
Params78M
Context128K
Smallest0.1 GB
EV
EAN 3B i1
Evan · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
SM
SmolLM2 135M Instruct Q4 K M
SmolLM · jc-builds
Params135M
Context8K
Q4_K_M0.1 GB
DA
danube2-1.8b-openhermes
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GE
Gemma 4 E2B It Assistant
Gemma · AtomicChat
Params77M
Context128K
Q4_K_M0.1 GB
NE
nexus coder
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
SA
Salt Asr_Wav Uni_1_Tts_Wav Uni_1 12k
Salt · RichardErkhov
Params3.23B
Context128K
Q4_K_M2.0 GB