Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
IR
Irwan LightOnOCR 3 0.8B Abliterated
Irwan · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
TH
Thanos 3B
Thanos · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
ZE
gguf zephyr 220m dpo full
Zephyr · Felladrin
Params218M
Context2K
Q4_K_M0.2 GB
GGUF
SA
SauerkrautLM-1.5b
Sauerkrautlm · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen 2.5 3B GRPO Reasoning XIOSERV
Qwen · AaryanK
Params3.09B
Context32K
Smallest2.2 GB
ReasoningTool use
MA
Mamba gpt 3B v4 ggml and
Mamba · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
MU
Muse-Glimmer-30B-DFlash2
Muse · z-lab
Params2.77B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
QW
Qwen3.5 2b Grpo Synsql
Qwen · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
GR
granite-3b-code-glaive-20k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
GE
gemma 2b it GGUF smashed
Gemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LI
LightOnOCR 3 0.8B
Lightonocr · richardyoung
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
PA
Pallete 2.6B RP Reasoning 2609 V1A
Pallete · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningRoleplay
MX
mxbai-rerank-large-v2
Mxbai · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
EmbeddingTool use
SE
SeaLLMs v3 1.5B Chat
Seallms · RichardErkhov
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
JA
AI21 Jamba2 3B
Jamba · bartowski
Params3.2B
Context256K
Q4_K_M1.9 GB
Tool use
GR
Granite Vision 3.2 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
QW
Ektome Qwen2.5 3Bi PristinelyUncensored
Qwen · Zynerji
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
FA
Faust 1
Faust · tabularisai
Params1.61B
Context40K
Smallest1.7 GB
GGUF
CH
chinese alpaca 2 1.3b rlhf
Chinese · hfl
Params1.26B
Context4K
Smallest0.6 GB
GGUF
JE
Jedi 3B 1080p
Jedi · bartowski
Params3.09B
Context125K
Q4_K_M1.9 GB
Tool useVision
WI
Wiguel AI
Wiguel · Miguelms13
Params1.78B
Context—
Smallest1.1 GB
GGUF
AC
AceTranslatePro models
Acetranslatepro · tianclll
Params1.78B
Context256K
Q4_K_M1.1 GB
Tool useVision
MI
Huihui Ministral 3B Instruct 2512 abliterated
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
GGUF
TI
TinyLlama 1.1B Chat v0.2
Tinyllama · kirp
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
QW
Qwopus3.6 35B A3B v1 MTP HF
Qwen · Jackrong
Params447M
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
SP
Spark X2.6 4B EAGLE3
Spark · VitreousCut
Params218M
Context4K
Smallest0.4 GB
ReasoningTool use
PY
Pythia 70m
Pythia · mradermacher
Params70M
Context2K
Q4_K_M0.0 GB
GGUF
LF
LFM2.5 1.2B Z Image Engineer V4
Lfm · BennyDaBall
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use

Other sizes

Keep browsing