Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.1 30B Claude 4.6 Opus Thinking X
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GR
granite 3.1 1b a400m instruct
Granite · QuantFactory
Params1.38B
Context128K
Q4_K_M0.9 GB
Tool use
GR
Granite 3.2 8b Instruct Abliterated
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.2 2b Instruct
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite Speech 4.1 2b Plus
Granite · ibm-granite
Params1.63B
Context4K
Q4_K_M1.0 GB
Tool useVision
GR
Granite 4.0 Tiny Preview
Granite · ibm-granite
Params6.67B
Context1024K
Q4_K_M4.0 GB
ReasoningTool use
GR
Granite 4.0 Micro BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite 4.0 H 350m Base
Granite · ibm-granite
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
GR
Granite 3.2 8b Instruct Preview
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
TwIL LM2
Granite · webAI-Official
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite Speech 3.3 8b
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Huihui Ai.Granite 3.2 2b Instruct Abliterated
Granite · DevQuasar-5
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 3b Code Instruct 2k
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
Granite 3.0 1b A400M Instruct
Granite · mradermacher
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use
GR
Model Ibm Granite Granite 3.1 3b A800M Instruct Cache
Granite · Alcoft
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
Granite 7b Instruct
Granite · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GR
Granite Speech 3.2 8b
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.1 Earthen v0.3 3B A800M
Granite · PJMixers-Dev
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
Granite 4.0 H 3b Ar
Granite · mradermacher
Params3.4B
Context1024K
Q4_K_M2.1 GB
Tool use
GR
Granite 34b Code Instruct 8k
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
CodingTool use
GR
TAEL Agent
Granite · SiddardhaShayini
Params2.53B
Context128K
Q4_K_M1.5 GB
CodingTool use
GR
Granite 4.2 8b
Granite · webAI-Official
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
granite-20b-code-instruct-r1.1
Granite · Mungert
Params20.1B
Context8K
Q4_K_M12.6 GB
CodingReasoningTool use
GR
ha voice granite 3b
Granite · infohound
Params3.4B
Context128K
Smallest3.6 GB
Tool use
GR
Granite 4.0 H Small Heretic_Med
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
Tool use
GR
Granite 3b Code Base 2k
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
Granite 4.0 7B A1B Creative v0.1
Granite · mradermacher
Params6.67B
Context1024K
Q4_K_M4.0 GB
ReasoningTool use
GR
granite-3.0-2b-instruct
Granite · Mungert
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
GR
Huihui Granite 4.0 H Tiny Abliterated
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
Tool use
GR
Granite 4.0 Tiny Base Preview
Granite · ibm-granite
Params6.67B
Context1024K
Q4_K_M4.1 GB
GGUF

Keep browsing