Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 4.0 Micro
Granite · MichielBuisman
Params3.4B
Context128K
Smallest2.1 GB
GR
Ibm Granite.Granite 20b Functioncalling
Granite · DevQuasar-8
Params20.1B
Context8K
Q4_K_M12.8 GB
GR
SOLARized GraniStral 14B_2102_YeAM HCT_32QKV
Granite · srs6901
Params13.5B
Context256K
Smallest8.2 GB
GR
Huihui granite 4.1 30b abliterated
Granite · Momix-44
Params28.9B
Context128K
Smallest57.7 GB
GR
granite 20b code instruct 8k
Granite · ibm-granite
Params20.1B
Context8K
Q4_K_M12.8 GB
GR
Granite 4.2 3B Heretic NX PRIME beta 2.4
Granite · 0xzknw
Params3.66B
Context128K
Q4_K_M2.2 GB
GR
granite h350m event commands
Granite · rbrmafort
Params340M
Context1024K
Q4_K_M0.2 GB
GR
Leesplank Noot Granite 3.3 2b
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 4.0 350m Gabliterated
Granite · mradermacher
Params352M
Context32K
Q4_K_M0.2 GB
GR
pharos judge free
Granite · pharos-one
Params3.4B
Context128K
Smallest3.6 GB
GR
Granite 4.0 H Micro Base
Granite · tatsuyaaaaaaa
Params3.19B
Context1024K
Q4_K_M1.9 GB
GR
Granite 4.1 Queen 30b
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1
Granite · DevQuasar-9
Params6.85B
Context8K
Q4_K_M6.0 GB
GR
granite embedding 278m multilingual
Granite · cstr
Params277M
Context514
Smallest0.3 GB
GR
Granite Docling 258M
Granite · prithivMLmods
Params164M
Context8K
Smallest0.2 GB
GR
Ibm Granite.Granite 3.1 8b Base
Granite · DevQuasar-6
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Ibm Granite Granite 3.0 8b Instruct
Granite · tensorblock
Params8.17B
Context4K
Smallest3.1 GB
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3
Granite · DevQuasar-9
Params6.85B
Context8K
Q4_K_M6.0 GB
GR
granite 34b code base 8k
Granite · ibm-granite
Params33.7B
Context8K
Q4_K_M21.4 GB
GR
Granite 4.1 3B SFT Fable5
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
granite 3.0 8b base
Granite · neopolita
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
Granite 3.0 2b Instruct
Granite · lmstudio-community
Params2.63B
Context4K
Q4_K_M1.6 GB
GR
Granite 4.2 8b Decensored
Granite · qcokvd1
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
granite 4.1 3b wh40k tools
Granite · jressler
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Ibm Granite.Granite 4.1 8b
Granite · DevQuasar
Params8.79B
Context128K
Smallest3.4 GB
GR
Ibm Granite.Granite 4.0 350m
Granite · DevQuasar
Params352M
Context32K
Q4_K_M0.2 GB
GR
SOLARized GraniStral 14B_2202_YeAM HCT_X45QKV
Granite · srs6901
Params13.5B
Context256K
Smallest8.2 GB
GR
Granite Estigia MultilanguageV3
Granite · mradermacher
Params3.3B
Context128K
Q4_K_M2.0 GB
GR
granite 20b code base 8k
Granite · ibm-granite
Params20.1B
Context8K
Q4_K_M12.8 GB
GR
granite-3.0-2b-base
Granite · Mungert
Params2.53B
Context4K
Q4_K_M1.5 GB