Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 3.2 2b Instruct
Granite · stefanberger
Params2.53B
Context128K
Smallest1.0 GB
Tool use
GR
granite 4.0 h tiny gguf q8 0
Granite · keisuke-miyako
Params6.94B
Context1024K
Smallest7.4 GB
Tool use
GR
dataserve granite4 ft
Granite · aaaelgendy
Params3.19B
Context1024K
Smallest6.4 GB
Tool use
GR
Granite 3.0 3b A800M Instruct R241010A
Granite · RedHatAI
Params3.37B
Context4K
Q4_K_M2.1 GB
Tool use
GR
Granite 3.2 8b Instruct Preview
Granite · LucyxDQ
Params8.17B
Context128K
Smallest4.7 GB
Tool use
GR
Granite Guardian 3.2 5b
Granite · stefanberger
Params5.78B
Context128K
Q4_K_M3.5 GB
Tool use
GR
Granite 3.0 8b Instruct
Granite · psolarvi
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
granite guardian 3.2 3b a800m
Granite · jbarguti
Params3.3B
Context128K
Smallest3.5 GB
Tool use
GR
Granite 3.3 2b Instruct
Granite · samuellimabraz
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
granite embedding english r2 gguf q4 k m
Granite · keisuke-miyako
Params149M
Context8K
Q4_K_M0.1 GB
Embedding
GR
Granite Estigia Multilanguage
Granite · franciscobdl
Params3.3B
Context128K
Smallest3.5 GB
Tool use
GR
hawky ai ibm granite 3.0 2b instruct
Granite · Sri-Vigneshwar-DJ
Params2.63B
Context4K
Smallest5.3 GB
Tool use
GR
Granite 3.3 8b Creative
Granite · AndresCripto
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
fine tuned granite 4 h 1b
Granite · raznaee
Params1.46B
Context1024K
Smallest2.9 GB
Tool use
GR
Granite 4.0 350m
Granite · Himanshusanecha
Params352M
Context32K
Smallest0.3 GB
GGUF
GR
granite guardian 3.2 8b
Granite · jbarguti
Params8.17B
Context128K
Smallest8.7 GB
Tool use
GR
granite3.3 8b 20260526
Granite · REALMS-CG
Params8.17B
Context128K
Smallest4.9 GB
ReasoningTool use
GR
granite 4 feature extraction
Granite · csanz91
Params3.19B
Context1024K
Smallest3.4 GB
Tool use
GR
zaad plus granite v1 2 preview
Granite · unclle
Params340M
Context1024K
Q4_K_M0.2 GB
Tool use
GR
Dingdust granite 4.2 8b heretic lora
Granite · AnkitBirGurung
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite 3.0 2b Instruct R241014A
Granite · RedHatAI
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
GR
glyphgate genie granite 2b
Granite · mechalord7
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
aiops granite 7b lab trained
Granite · amellouli
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GR
granite 3.0 8b instruct
Granite · lohbe
Params8.17B
Context4K
Smallest16.3 GB
Tool use
GR
Granite 3.0 3b A800M Instruct
Granite · mitulagr2
Params3.37B
Context4K
Smallest2.5 GB
Tool use
GR
Granite 3.0 1b A400M Instruct
Granite · mitulagr2
Params1.33B
Context4K
Smallest1.0 GB
Tool use
GR
Granite Docling 258M
Granite · luigidemasi
Params164M
Context8K
Smallest0.3 GB
GGUF
GR
granite4 h micro GGUF v1
Granite · fqb
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
GR
granite4 h micro
Granite · fqb
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
GR
Granite 4.0 H Micro Finlab v2 Gguf Q4Km
Granite · k0m1anvi
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use

Keep browsing