Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 4.0 H Micro Base
Granite · mrutkows
Params3.19B
Context1024K
Q4_K_M1.9 GB
GR
Granite Speech 4.1 2B
Granite · voicetide
Params2.31B
Context—
Smallest1.8 GB
GR
Granite 3.1 2B RYS 19 24
Granite · john-broadway
Params2.84B
Context128K
Q4_K_M1.7 GB
GR
granite-8b-code-instruct
Granite · pankaj217
Params8.05B
Context4K
Smallest5.7 GB
GR
Granite 3.1 1b A400M Base
Granite · elichen-skymizer
Params1.33B
Context128K
Smallest1.1 GB
GR
Granite 3.1 2b Instruct
Granite · Lucy-in-the-Sky
Params2.53B
Context128K
Smallest2.7 GB
GR
Granite 4.1 3b
Granite · llmware
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 4.2 30b Nvfp4
Granite · FedericoFB
Params29.3B
Context128K
Smallest17.7 GB
GR
granite 4.1 3b manumit v1
Granite · yethdev
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 3.2 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context128K
Smallest8.7 GB
GR
granite 7b lab ocp4.15 v0.3
Granite · boricua
Params6.74B
Context2K
Smallest13.5 GB
GR
Granite 3.1 2b FourWheeler
Granite · Prithwiraj731
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite-4.1-8B
Granite · llmware
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 3.1 2b Instruct
Granite · jesusoctavioas
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 4.1 3b
Granite · 1bit-MONSTER
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 4.1 8b
Granite · SandLogicTechnologies
Params8.79B
Context128K
Smallest4.1 GB
GR
Ibm Granite3.3 8b Ethical v0.1
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite Guardian 3.1 8b
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Ibm Granite Granite 3b Code Base 128k
Granite · tensorblock
Params3.48B
Context125K
Smallest1.3 GB
GR
Granite 3.1 2b Instruct
Granite · pasan1992
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 4.1 8b
Granite · viniciusianni
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
granite 20b code instruct Q5 K M
Granite · cobrakenji
Params20.1B
Context8K
Smallest14.7 GB
GR
Granite 3.1 8b Instruct
Granite · msyukorai
Params8.17B
Context128K
Smallest4.7 GB
GR
Granite Guardian 3.0 8b
Granite · mrutkows
Params8.17B
Context8K
Q4_K_M4.9 GB
GR
Huihui Granite 4.1 3b Abliterated
Granite · googlecs
Params3.4B
Context128K
Smallest3.6 GB
GR
Granite 3.3 2b Instruct
Granite · Edge-Quant
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 4.1 8B SFT Fable5 Glint
Granite · ermiaazarkhalili
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 4.0 H 1b Heretic
Granite · alexwirrell
Params1.46B
Context1024K
Q4_K_M0.9 GB
GR
Granite Speech 4.1 2B NAR
Granite · voicetide
Params2.25B
Context—
Smallest1.8 GB
GR
granite guardian 3.0 2b
Granite · Creed-Space
Params2.53B
Context8K
Q4_K_M1.5 GB