Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 4.1 30b Heretic
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
GR
ibm-granite/granite-timeseries-flowstate-r1
Granite · amaye15
Params9M
Context2K
Smallest0.0 GB
GR
granite 4.2 3b TPN
Granite · tpnlabs
Params3.66B
Context128K
Q4_K_M2.2 GB
GR
Granite 4.1 30B Claude 4.6 Opus Thinking Xavier
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
GR
Granite 4.0 1b Speech
Granite · mrutkows
Params1.84B
Context4K
Q4_K_M1.1 GB
GR
Heretic_Granite 3.3 2b Instruct
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Ibm Granite Granite 4.1 8b
Granite · batiai
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 4.0 H Small
Granite · Myric
Params32.2B
Context1024K
Smallest13.4 GB
GR
Granite 3.0 2b Instruct
Granite · Felladrin
Params2.63B
Context4K
Smallest1.9 GB
GR
Granite 3.0 8b Base
Granite · RichardErkhov
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
Granite 3.1 8b Base
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite Speech 4.1 2B NAR
Granite · epapanita
Params2.25B
Context—
Q4_K_M1.6 GB
GR
granite 4.2 8b G Q5
Granite · darioooooo0o
Params8.79B
Context128K
Smallest0.0 GB
GR
BrainsV3
Granite · Lerelou
Params3.4B
Context128K
Smallest2.1 GB
GR
Granite 4.0 H Small Base
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
GR
Granite 4.0 Micro Base
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 4.1 8b Brainstone2 Thinking
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 4.0 7B A1B Creative v0.3
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
GR
Vetta Granite 2b v3
Granite · mradermacher
Params2.53B
Context4K
Q4_K_M1.5 GB
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3
Granite · DevQuasar-10
Params6.85B
Context8K
Q4_K_M6.0 GB
GR
Granite 3.0 1b A400M Base
Granite · mradermacher
Params1.38B
Context4K
Q4_K_M0.9 GB
GR
ibm granite.granite 3.0 8b lora intrinsics v0.1
Granite · DevQuasar-6
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
Granite 4.0 H 1b Base
Granite · mradermacher
Params1.46B
Context1024K
Q4_K_M0.9 GB
GR
Granite 4.0 Micro Heretic
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 4.1 3b Heretic
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 3.1 8b Base
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
granite-8b-code-base
Granite · ibm-granite
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Ibm Granite.Granite Guardian 3.1 8b
Granite · DevQuasar-6
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite 4.0 Tiny Preview
Granite · mrutkows
Params6.67B
Context1024K
Q4_K_M4.0 GB
GR
Granite 4.1 3b coder
Granite · ertghiu256
Params3.4B
Context128K
Q4_K_M2.1 GB