Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 3b Code Base 128k
Granite · RichardErkhov
Params3.48B
Context125K
Q4_K_M2.1 GB
GR
Granite 4.0 350m
Granite · ibm-granite
Params352M
Context32K
Q4_K_M0.2 GB
GR
Granite 4.0 H 1B BE
Granite · taronaeo
Params1.46B
Context—
Q4_K_M0.9 GB
GR
granite-3b-code-base
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
Granite 4.2 3b
Granite · bartowski
Params3.66B
Context128K
Q4_K_M2.3 GB
GR
Granite 7b Base
Granite · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
Granite Speech 5.0 2b
Granite · ibm-granite
Params1.84B
Context16K
Q4_K_M1.1 GB
GR
granite-8b-code-instruct
Granite · ibm-granite
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite Guardian 4.1 8b
Granite · ibm-granite
Params8.38B
Context128K
Q4_K_M5.1 GB
GR
Granite 8b Code Instruct 4k
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite 8b Code Instruct
Granite · duyntnet
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite 4.2 30b
Granite · bartowski
Params29.3B
Context128K
Q4_K_M18.0 GB
GR
Granite 3b Code Instruct 128k
Granite · RichardErkhov
Params3.48B
Context125K
Q4_K_M2.1 GB
GR
Granite 4.0 H Small
Granite · bartowski
Params32.2B
Context1024K
Q4_K_M19.7 GB
GR
granite 4.2 8b heretic
Granite · saidutta69
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 3.1 3b A800M Instruct
Granite · bartowski
Params3.3B
Context128K
Q4_K_M2.0 GB
GR
Granite 8b Code Base 4k
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite 3b Code Base
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
Granite 3b Code Instruct 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
Granite 3.2 8b Instruct
Granite · bartowski
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite-4.0-Micro
Granite · unsloth
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite-4.0-H-1B
Granite · unsloth
Params1.46B
Context1024K
Q4_K_M0.9 GB
GR
Huihui Granite 4.1 3b Abliterated
Granite · huihui-ai
Params3.4B
Context128K
Smallest6.8 GB
GR
granite 4.2 3b heretic
Granite · saidutta69
Params3.66B
Context128K
Q4_K_M2.2 GB
GR
Granite 8b Code Base
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
granite embedding 125m english
Granite · bartowski
Params124M
Context512
Q4_K_M0.1 GB
GR
granite 3.1 2b instruct
Granite · QuantFactory
Params2.63B
Context128K
Q4_K_M1.6 GB
GR
granite speech 4.1 2b
Granite · cstr
Params2.31B
Context—
Smallest1.8 GB
GR
Granite 3.0 8b Lab Community
Granite · bartowski
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
granite-3b-code-base
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB