Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.2 30B BE
Granite · taronaeo
Params29.3B
Context128K
Q4_K_M17.7 GB
GGUF
GR
granite 4.1 8b heretic
Granite · saidutta69
Params8.38B
Context128K
Q4_K_M5.1 GB
RoleplayTool use
GR
granite-3b-code-base-128k
Granite · Mungert
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
GR
Parable Granite 4.1 3B Claude Fable 5 Heretic
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
ReasoningTool use
GR
Granite 4.0 H Small Heretic High
Granite · rodrigomt
Params32.2B
Context1024K
Smallest18.8 GB
Tool use
GR
Granite 4.1 3b
Granite · bartowski
Params3.4B
Context128K
Q4_K_M2.2 GB
Tool use
GR
Granite Cermat 7b
Granite · mradermacher
Params6.67B
Context1024K
Q4_K_M4.0 GB
ReasoningTool use
GR
Granite 4.0 Tiny Preview BE
Granite · taronaeo
Params6.67B
Context1024K
Q4_K_M4.0 GB
GGUF
GR
granite-8b-code-base-128k
Granite · Mungert
Params8.05B
Context125K
Q4_K_M4.8 GB
Coding
GR
Granite 3.2 8b Instruct
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
granite-4.0-tiny-preview
Granite · Mungert
Params6.67B
Context1024K
Q4_K_M4.2 GB
ReasoningTool use
GR
Granite 4.0 H 1b Base
Granite · ibm-granite
Params1.46B
Context1024K
Q4_K_M0.9 GB
GGUF
GR
granite-3b-code-instruct-2k
Granite · Mungert
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
GR
granite 4.0 h tiny DISTILL OPUS 4.5 think
Granite · glogwa68
Params7.09B
Context1024K
Q4_K_M4.3 GB
ReasoningTool use
GR
Granite 4.0 1b Base
Granite · ibm-granite
Params1.63B
Context128K
Q4_K_M1.0 GB
GGUF
GR
Granite 4.2 3b
Granite · mradermacher
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
Granite_42_30b_Abliterated
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GR
granite-3.2-8b-instruct
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
granite-3b-code-instruct-2k
Granite · Dzluck
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
GR
Huihui Granite 4.1 30b Abliterated
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
Tool use
GR
Granite Speech 5.0 470M TurboCTC NC
Granite · handy-computer
Params473M
Context—
Q4_K_M0.3 GB
GGUF
GR
granite-8b-code-base-4k
Granite · Mungert
Params8.05B
Context4K
Q4_K_M4.8 GB
Coding
GR
granite-20b-code-base-8k
Granite · Mungert
Params20.1B
Context8K
Q4_K_M12.6 GB
Coding
GR
Granite 4.1 8b Apostate
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Granite 4.0 H 3b Ar
Granite · mradermacher
Params3.4B
Context1024K
Q4_K_M2.1 GB
Tool use
GR
Granite Guardian 3.2 3b A800M
Granite · ibm-research
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
Granite 3.3 8b Qiskit
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Coding
GR
Ibm Granite_Granite 4.2 3b
Granite · lmstudio-community
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
Granite 4.2 30b
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GR
Granite 4.2 8B Surgical Abliterated
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use

Keep browsing