Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 4.1 8b Abliterated AND Disinhibited
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
GR
Granite 20b Code Base
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
GR
granite-4.0-h-350m
Granite · Mungert
Params340M
Context1024K
Q4_K_M0.2 GB
GR
Granite 20b Code Base 8k
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
GR
Granite 8b Code Instruct 128k
Granite · RichardErkhov
Params8.05B
Context125K
Q4_K_M4.9 GB
GR
Granite 4.0 H Tiny
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
GR
Granite Guardian 4.1 8b
Granite · mrutkows
Params8.38B
Context128K
Q4_K_M5.1 GB
GR
Granite 8b Code Instruct 4k
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite 4.2 30b
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
GR
granite-4.0-h-micro
Granite · Mungert
Params3.2B
Context1024K
Q4_K_M2.0 GB
GR
Granite 7b Base
Granite · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
Granite 8b Code Base 4k
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite 34b Code Base 8k
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
GR
Huihui Granite 4.1 30b Abliterated
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
GR
Granite 3.0 8b Instruct
Granite · bartowski
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
Granite Switch 4.1 30b
Granite · ibm-granite
Params30.6B
Context128K
Q4_K_M21.0 GB
GR
Granite Embedding 278m Multilingual
Granite · bartowski
Params278M
Context512
Q4_K_M0.2 GB
GR
Granite 4.0 H Micro
Granite · bartowski
Params3.2B
Context1024K
Q4_K_M1.9 GB
GR
Granite 3.0 1b A400M Instruct
Granite · bartowski
Params1.33B
Context4K
Q4_K_M0.8 GB
GR
Granite-4.0-1B
Granite · unsloth
Params1.63B
Context128K
Q4_K_M1.0 GB
GR
Granite 3.0 3b A800M Instruct
Granite · bartowski
Params3.37B
Context4K
Q4_K_M2.1 GB
GR
Granite Speech 5.0 2b
Granite · mradermacher
Params1.84B
Context16K
Q4_K_M1.1 GB
GR
Granite Speech 5.0 470M TurboCTC
Granite · handy-computer
Params473M
Context—
Q4_K_M0.3 GB
GR
Huihui Granite 4.0 H Tiny Abliterated
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
GR
granite 8b code instruct 4k
Granite · QuantFactory
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite 3.3 2b Base
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
granite 3.1 8b Reasoning i1
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
granite 3b code base 2k
Granite · QuantFactory
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
Granite 8b Code Instruct 128k
Granite · mradermacher
Params8.05B
Context125K
Q4_K_M4.9 GB
GR
granite 4.1 3b heretic
Granite · saidutta69
Params3.4B
Context128K
Q4_K_M2.1 GB