Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 4.2 30B BE
Granite · taronaeo
Params29.3B
Context128K
Q4_K_M17.7 GB
GR
granite 4.1 8b heretic
Granite · saidutta69
Params8.38B
Context128K
Q4_K_M5.1 GB
GR
granite-3b-code-base-128k
Granite · Mungert
Params3.48B
Context125K
Q4_K_M2.1 GB
GR
Parable Granite 4.1 3B Claude Fable 5 Heretic
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 4.0 H Small Heretic High
Granite · rodrigomt
Params32.2B
Context1024K
Smallest18.8 GB
GR
Granite 4.1 3b
Granite · bartowski
Params3.4B
Context128K
Q4_K_M2.2 GB
GR
Granite Cermat 7b
Granite · mradermacher
Params6.67B
Context1024K
Q4_K_M4.0 GB
GR
Granite 4.0 Tiny Preview BE
Granite · taronaeo
Params6.67B
Context1024K
Q4_K_M4.0 GB
GR
granite-8b-code-base-128k
Granite · Mungert
Params8.05B
Context125K
Q4_K_M4.8 GB
GR
Granite 3.2 8b Instruct
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
granite-4.0-tiny-preview
Granite · Mungert
Params6.67B
Context1024K
Q4_K_M4.2 GB
GR
Granite 4.0 H 1b Base
Granite · ibm-granite
Params1.46B
Context1024K
Q4_K_M0.9 GB
GR
granite-3b-code-instruct-2k
Granite · Mungert
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
granite 4.0 h tiny DISTILL OPUS 4.5 think
Granite · glogwa68
Params7.09B
Context1024K
Q4_K_M4.3 GB
GR
Granite 4.0 1b Base
Granite · ibm-granite
Params1.63B
Context128K
Q4_K_M1.0 GB
GR
Granite 4.2 3b
Granite · mradermacher
Params3.66B
Context128K
Q4_K_M2.2 GB
GR
Granite_42_30b_Abliterated
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
GR
granite-3.2-8b-instruct
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
granite-3b-code-instruct-2k
Granite · Dzluck
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
Huihui Granite 4.1 30b Abliterated
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
GR
Granite Speech 5.0 470M TurboCTC NC
Granite · handy-computer
Params473M
Context—
Q4_K_M0.3 GB
GR
granite-8b-code-base-4k
Granite · Mungert
Params8.05B
Context4K
Q4_K_M4.8 GB
GR
granite-20b-code-base-8k
Granite · Mungert
Params20.1B
Context8K
Q4_K_M12.6 GB
GR
Granite 4.1 8b Apostate
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 4.0 H 3b Ar
Granite · mradermacher
Params3.4B
Context1024K
Q4_K_M2.1 GB
GR
Granite Guardian 3.2 3b A800M
Granite · ibm-research
Params3.3B
Context128K
Q4_K_M2.0 GB
GR
Granite 3.3 8b Qiskit
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Ibm Granite_Granite 4.2 3b
Granite · lmstudio-community
Params3.66B
Context128K
Q4_K_M2.2 GB
GR
Granite 4.2 30b
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
GR
Granite 4.2 8B Surgical Abliterated
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB