Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 3 Flux Final
Granite · mradermacher
Params8.37B
Context4K
Q4_K_M5.1 GB
GR
Granite 4.1 3B Function Calling xLAM Unsloth
Granite · ermiaazarkhalili
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 4.2 30b
Granite · llmware
Params29.3B
Context128K
Q4_K_M17.7 GB
GR
Granite 3.0 1b A400M Instruct
Granite · mrutkows
Params1.33B
Context4K
Q4_K_M0.8 GB
GR
Ibm Granite.Granite 3.1 3b A800M Instruct
Granite · DevQuasar-6
Params3.3B
Context128K
Q4_K_M2.0 GB
GR
Granite 3.1 8b Base
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Ibm Granite.Granite 4.0 H 1b
Granite · DevQuasar
Params1.46B
Context1024K
Q4_K_M0.9 GB
GR
Granite 4.1 8b
Granite · bombman
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 4.0 H 32A9B Creative v1.1
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
GR
Granite 4.1 8b
Granite · Lauarvik
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 4.2 3b
Granite · llmware
Params3.66B
Context128K
Q4_K_M2.2 GB
GR
Granite 4.2 8b
Granite · llmware
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 3.1 2b Instruct
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 4.1 8b
Granite · mrutkows
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Ibm Granite.Granite 3.0 1b A400M Instruct
Granite · DevQuasar-3
Params1.33B
Context4K
Q4_K_M0.8 GB
GR
Granite 4.1 30b Base
Granite · kimi-chan
Params28.9B
Context128K
Q4_K_M17.5 GB
GR
Granite Embedding 30m English
Granite · lmstudio-community
Params30M
Context512
Q4_K_M0.0 GB
GR
Granite 4.1 Queen 8b
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
GR
Granite 3.3 2b Instruct Ethics
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 4.0 1b Base
Granite · mradermacher
Params1.63B
Context128K
Q4_K_M1.0 GB
GR
Granite Guardian 3.2 5b
Granite · mradermacher
Params5.78B
Context128K
Q4_K_M3.5 GB
GR
granite-docling-258M
Granite · Mungert
Params164M
Context8K
Q4_K_M0.1 GB
GR
Ibm Granite.Granite 3.1 3b A800M Base
Granite · DevQuasar-6
Params3.3B
Context128K
Q4_K_M2.0 GB
GR
Granite 4.0 H Small Heretic_Med
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
GR
Granite 3.1 8b Instruct
Granite · mradermacher
Params8.37B
Context128K
Q4_K_M5.1 GB
GR
granite 34b code instruct 8k
Granite · ibm-granite
Params33.7B
Context8K
Q4_K_M21.4 GB
GR
Granite 4.0 H Tiny
Granite · ZuzeTt
Params6.94B
Context1024K
Q4_K_M4.2 GB
GR
Granite Docling 258M
Granite · SandLogicTechnologies
Params164M
Context8K
Smallest0.1 GB
GR
Granite 3.1 2b Instruct Abliterated
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
granite 4.2 3b heretic abliterated
Granite · snellchapo
Params3.66B
Context128K
Q4_K_M2.2 GB