Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 3.0 2b Instruct
Granite · bartowski
Params2.63B
Context4K
Q4_K_M1.6 GB
GR
Granite Vision 3.2 2b
Granite · bartowski
Params2.53B
Context16K
Q4_K_M1.5 GB
GR
Granite 3.1 8b Instruct
Granite · lmstudio-community
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite 4.2 8b Heretic
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 3.2 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite Speech 3.2 8b
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
granite 7b instruct
Granite · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
granite speech 4.1 2b nar
Granite · cstr
Params2.25B
Context—
Smallest1.6 GB
GR
granite 20b functioncalling
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
GR
Granite 3.1 8b Instruct
Granite · EasierAI
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
granite-7b-base
Granite · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GR
Ibm Granite_Granite 4.2 8b
Granite · lmstudio-community
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 4.1 30b
Granite · bartowski
Params28.9B
Context128K
Q4_K_M17.8 GB
GR
granite 7b lab
Granite · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
granite-8b-code-base
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite 3.2 2b Instruct
Granite · EasierAI
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 8b Code Base 4k
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite Guardian 3.3 8b
Granite · ibm-granite
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
granite speech 4.1 2b plus
Granite · cstr
Params2.32B
Context—
Smallest1.7 GB
GR
Granite 4.1 8b Heretic
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
GR
granite-3b-code-instruct
Granite · SanctumAI
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
Granite 4.1 30b
Granite · ibm-granite
Params28.9B
Context128K
Q4_K_M17.5 GB
GR
Granite 3.0 8b Base
Granite · mradermacher
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
Granite 4.2 8b
Granite · nile-academy
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 3.3 2b Instruct
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite-3.3-8B-Instruct
Granite · unsloth
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
docling
Granite · gguf-org
Params258M
Context—
Q4_K_M0.5 GB
GR
Granite 3.2 2b Instruct
Granite · ibm-research
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 4.0 Tiny Preview
Granite · bartowski
Params6.67B
Context1024K
Q4_K_M4.1 GB
GR
Granite 3.0 2b Instruct
Granite · mradermacher
Params2.63B
Context4K
Q4_K_M1.6 GB