Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 4.1 3b Heretic
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Ibm Granite Granite 8b Code Base 4k
Granite · tensorblock
Params8.05B
Context4K
Smallest3.1 GB
GR
granite 8b rpgle
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Ibm Granite Granite 3b Code Base 2k
Granite · tensorblock
Params3.48B
Context2K
Smallest1.3 GB
GR
Granite 3.0 2b Instruct
Granite · duyntnet
Params2.63B
Context4K
Q4_K_M1.6 GB
GR
Granite 3.1 2b Instruct
Granite · lmstudio-community
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 20b Code Instruct R1.1
Granite · mradermacher
Params20.1B
Context8K
Q4_K_M12.8 GB
GR
Granite 4.0 Micro Heretic Uncensored
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
granite-3.1-3b-a800m-instruct
Granite · Mungert
Params3.3B
Context128K
Smallest1.2 GB
GR
Granite 4.0 H Small Heretic_Hi
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
GR
Ibm Granite.Granite 4.0 H Small
Granite · DevQuasar
Params32.2B
Context1024K
Q4_K_M19.5 GB
GR
Granite Guardian 3.2 3b A800M
Granite · mradermacher
Params3.3B
Context128K
Q4_K_M2.0 GB
GR
Granite 4.1 8b Apostate
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
granite 3.0 8b base
Granite · QuantFactory
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
Granite 3.1 2b Base
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 3.2 2b Instruct
Granite · lmstudio-community
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Ibm Granite_Granite 4.0 H Small
Granite · lmstudio-community
Params32.2B
Context1024K
Q4_K_M19.5 GB
GR
Ibm Granite Granite 3.1 8b Instruct
Granite · tensorblock
Params8.17B
Context128K
Smallest3.1 GB
GR
Ibm Granite.Granite 3.1 2b Instruct
Granite · DevQuasar-6
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 3.3 2b Instruct
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite Guardian 3.1 8b
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite Guardian 3.0 2b
Granite · RichardErkhov
Params2.53B
Context8K
Q4_K_M1.5 GB
GR
Granite 4.2 3B Uncensored Conversational
Granite · minas2025
Params3.66B
Context128K
Smallest3.0 GB
GR
Ibm Granite.Granite 3.0 8b Instruct
Granite · DevQuasar-8
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
Granite 3.1 1b A400M Instruct
Granite · mrutkows
Params1.33B
Context128K
Q4_K_M0.8 GB
GR
Granite 3.2 8b Instruct
Granite · CISCai
Params8.17B
Context128K
Smallest1.8 GB
GR
MoE Girl 400MA 1BT
Granite · QuantFactory
Params1.33B
Context8K
Q4_K_M0.8 GB
GR
Granite 3.1 8b Instruct
Granite · mradermacher
Params8.37B
Context128K
Q4_K_M5.1 GB
GR
Granite Guardian 3.3 8b
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite 4.1 8b Abliterated
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB