Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
granite speech 5.0 2b
Granite · cstr
Params2.31B
Context—
Smallest4.1 GB
GGUF
GR
Granite 4.1 3b Abilerated Unc
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 4.2 30B xVITA zhTW
Granite · xCloudinfo
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GR
Granite Claude Code Final Agent
Granite · SiddardhaShayini
Params2.53B
Context128K
Q4_K_M1.5 GB
CodingTool use
GR
ticlazau granite 8b instruct rpgle
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
GGUF
GR
granite-20b-code-instruct-8k
Granite · Mungert
Params20.1B
Context8K
Q4_K_M12.6 GB
CodingTool use
GR
Granite 3.0 8b Instruct
Granite · mradermacher
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Wattson Granite 4.2 8b Py
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
granite embedding 311m multilingual r2
Granite · sonalect
Params312M
Context32K
Smallest0.0 GB
Embedding
GR
Granite 3.3 8b Base
Granite · ibm-granite
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
granite 4.1 8b
Granite · eaddario
Params8.79B
Context128K
Smallest0.0 GB
GGUF
GR
Granite Speech 4.1 2b Plus
Granite · mradermacher
Params1.63B
Context4K
Q4_K_M1.0 GB
Tool use
GR
Granite 4.0 H 1b Heretic
Granite · mradermacher
Params1.46B
Context1024K
Q4_K_M0.9 GB
Tool use
GR
Ibm Granite.Granite Guardian 3.1 2b
Granite · DevQuasar-11
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 3.3 8b Base
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.1 30B Claude 4.6 Opus Thinking Charles Xavier
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GR
granite-8b-code-base
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
GR
Huihui Ai.Granite 3.2 8b Instruct Abliterated
Granite · DevQuasar-5
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.2 2b Instruct
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 4.0 1b
Granite · mrutkows
Params1.63B
Context128K
Q4_K_M1.0 GB
Tool use
GR
MoE Girl 800MA 3BT
Granite · QuantFactory
Params3.3B
Context8K
Q4_K_M2.0 GB
Roleplay
GR
Parable Granite 4.1 3B Claude Fable 5
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
ReasoningTool use
GR
Granite 3.1 2b Instruct OBLITERATED
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 3.1 2b Instruct Abliterated
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 8b Code Base 128k
Granite · DevQuasar-2
Params8.05B
Context125K
Q4_K_M4.9 GB
Coding
GR
Granite 4.1 8b Tangerine
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
granite 4.2 8b
Granite · NANI-Nithin
Params8.8B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite 4.2 8b
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite 3.2 8b Instruct Preview
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.1 8B Function Calling xLAM Unsloth
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use

Keep browsing