Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 3.3 2b Instruct
Granite · ibm-granite
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite-4.1-3B
Granite · unsloth
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 3.1 1b A400M Instruct
Granite · bartowski
Params1.33B
Context128K
Q4_K_M0.8 GB
GR
granite-8b-code-instruct
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite-4.1-8B
Granite · unsloth
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 4.0 1b
Granite · ibm-granite
Params1.63B
Context128K
Q4_K_M1.0 GB
GR
Granite 20b Code Instruct 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
GR
Granite 8b Code Base 128k
Granite · mradermacher
Params8.05B
Context125K
Q4_K_M4.9 GB
GR
Granite 3.1 8b Instruct
Granite · bartowski
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite 4.2 8b
Granite · bartowski
Params8.79B
Context128K
Q4_K_M5.5 GB
GR
Ibm Granite_Granite 4.0 H Tiny
Granite · lmstudio-community
Params6.94B
Context1024K
Q4_K_M4.2 GB
GR
Granite 20b Code Instruct R1.1
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
GR
Granite 4.0 H 350m
Granite · ibm-granite
Params340M
Context1024K
Q4_K_M0.2 GB
GR
granite-3b-code-instruct
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
Granite-4.0-H-Small
Granite · unsloth
Params32.2B
Context1024K
Q4_K_M19.6 GB
GR
Granite 34b Code Instruct 8k
Granite · RichardErkhov
Params33.7B
Context8K
Q4_K_M21.4 GB
GR
granite 20b code instruct i1
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
GR
Granite 3.1 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Kiesel v2
Granite · mradermacher
Params8.8B
Context128K
Q4_K_M5.3 GB
GR
Granite 20b Functioncalling
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
GR
Granite 4.0 H 1b
Granite · ibm-granite
Params1.46B
Context1024K
Q4_K_M0.9 GB
GR
Granite 20b Code Base R1.1
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
GR
Granite 34b Code Base 8k
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
GR
Granite 3b Code Instruct 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
Granite 3b Code Base 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
Granite 20b Code Instruct
Granite · legraphista
Params20B
Context8K
Smallest4.5 GB
GR
Granite 8b Code Base 128k
Granite · RichardErkhov
Params8.05B
Context125K
Q4_K_M4.9 GB
GR
Granite 3b Code Instruct
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
Granite 4.0 H Tiny
Granite · bartowski
Params6.94B
Context1024K
Q4_K_M4.3 GB
GR
granite 20b functioncalling i1
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB