Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 3.2 2b Instruct
Granite · stefanberger
Params2.53B
Context128K
Smallest1.0 GB
GR
granite 4.0 h tiny gguf q8 0
Granite · keisuke-miyako
Params6.94B
Context1024K
Smallest7.4 GB
GR
dataserve granite4 ft
Granite · aaaelgendy
Params3.19B
Context1024K
Smallest6.4 GB
GR
Granite 3.0 3b A800M Instruct R241010A
Granite · RedHatAI
Params3.37B
Context4K
Q4_K_M2.1 GB
GR
Granite 3.2 8b Instruct Preview
Granite · LucyxDQ
Params8.17B
Context128K
Smallest4.7 GB
GR
Granite Guardian 3.2 5b
Granite · stefanberger
Params5.78B
Context128K
Q4_K_M3.5 GB
GR
Granite 3.0 8b Instruct
Granite · psolarvi
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
granite guardian 3.2 3b a800m
Granite · jbarguti
Params3.3B
Context128K
Smallest3.5 GB
GR
Granite 3.3 2b Instruct
Granite · samuellimabraz
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
granite embedding english r2 gguf q4 k m
Granite · keisuke-miyako
Params149M
Context8K
Q4_K_M0.1 GB
GR
Granite Estigia Multilanguage
Granite · franciscobdl
Params3.3B
Context128K
Smallest3.5 GB
GR
hawky ai ibm granite 3.0 2b instruct
Granite · Sri-Vigneshwar-DJ
Params2.63B
Context4K
Smallest5.3 GB
GR
Granite 3.3 8b Creative
Granite · AndresCripto
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
fine tuned granite 4 h 1b
Granite · raznaee
Params1.46B
Context1024K
Smallest2.9 GB
GR
Granite 4.0 350m
Granite · Himanshusanecha
Params352M
Context32K
Smallest0.3 GB
GR
granite guardian 3.2 8b
Granite · jbarguti
Params8.17B
Context128K
Smallest8.7 GB
GR
granite3.3 8b 20260526
Granite · REALMS-CG
Params8.17B
Context128K
Smallest4.9 GB
GR
granite 4 feature extraction
Granite · csanz91
Params3.19B
Context1024K
Smallest3.4 GB
GR
zaad plus granite v1 2 preview
Granite · unclle
Params340M
Context1024K
Q4_K_M0.2 GB
GR
Dingdust granite 4.2 8b heretic lora
Granite · AnkitBirGurung
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 3.0 2b Instruct R241014A
Granite · RedHatAI
Params2.63B
Context4K
Q4_K_M1.6 GB
GR
glyphgate genie granite 2b
Granite · mechalord7
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
aiops granite 7b lab trained
Granite · amellouli
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
granite 3.0 8b instruct
Granite · lohbe
Params8.17B
Context4K
Smallest16.3 GB
GR
Granite 3.0 3b A800M Instruct
Granite · mitulagr2
Params3.37B
Context4K
Smallest2.5 GB
GR
Granite 3.0 1b A400M Instruct
Granite · mitulagr2
Params1.33B
Context4K
Smallest1.0 GB
GR
Granite Docling 258M
Granite · luigidemasi
Params164M
Context8K
Smallest0.3 GB
GR
granite4 h micro GGUF v1
Granite · fqb
Params3.19B
Context1024K
Q4_K_M1.9 GB
GR
granite4 h micro
Granite · fqb
Params3.19B
Context1024K
Q4_K_M1.9 GB
GR
Granite 4.0 H Micro Finlab v2 Gguf Q4Km
Granite · k0m1anvi
Params3.19B
Context1024K
Q4_K_M1.9 GB