Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
granite 4.2 30b
Granite · Omega-Factory
Params29.3B
Context128K
Q4_K_M17.7 GB
GR
Granite 4.0 H 350m Unsloth
Granite · magiccodingman
Params340M
Context1024K
Smallest0.4 GB
GR
granite 3b code base
Granite · CastawayEGR
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
granite-8b-code-instruct
Granite · ethangoh
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
granite 4.0 h micro aegis content safety
Granite · meet12341234
Params3.19B
Context1024K
Smallest3.4 GB
GR
granite 3.1 1b a400m instruct APEX
Granite · Myric
Params1.33B
Context128K
Smallest0.5 GB
GR
Granite 4.1 30B Claude 4.6 Opus Thinking Charles Xavier
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
GR
Granite Speech 4.1 2B Plus
Granite · epapanita
Params2.11B
Context—
Q4_K_M1.5 GB
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1
Granite · DevQuasar-9
Params6.85B
Context8K
Q4_K_M6.0 GB
GR
steph speak granite 4.0 h 350M v2
Granite · lsmdx
Params340M
Context1024K
Q4_K_M0.2 GB
GR
Granite 3.0 3b A800M Base
Granite · mradermacher
Params3.37B
Context4K
Q4_K_M2.1 GB
GR
Granite 3b Code Base 128k
Granite · itlwas
Params3.48B
Context125K
Q4_K_M2.1 GB
GR
granite 4.0 h 350m router kd web4 s0
Granite · martinnavs
Params340M
Context1024K
Q4_K_M0.2 GB
GR
Instructlab Granite 7b Lab
Granite · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GR
Ibm Granite.Granite 4.2 8b
Granite · DevQuasar
Params8.79B
Context128K
Smallest3.4 GB
GR
granite guardian 3.0 8b
Granite · QuantFactory
Params8.17B
Context8K
Q4_K_M4.9 GB
GR
Granite Embedding 311m Multilingual R2
Granite · fisher046
Params312M
Context32K
Smallest0.3 GB
GR
Ibm Granite Granite 20b Functioncalling
Granite · tensorblock
Params20.1B
Context8K
Smallest7.9 GB
GR
Ibm Granite Granite 3.1 2b Instruct
Granite · tensorblock
Params2.53B
Context128K
Smallest1.0 GB
GR
granite-8b-code-instruct
Granite · cobrakenji
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite 4.1 8b Brainstone Thinking
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Apriel 1.5 15b Thinker Unsloth
Granite · magiccodingman
Params14.4B
Context256K
Smallest13.1 GB
GR
granite-8b-code-instruct
Granite · upendrab
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Ibm Granite Granite 3.0 1b A400M Instruct
Granite · tensorblock
Params1.33B
Context4K
Smallest0.5 GB
GR
Granite 8b Code Instruct 128k
Granite · charlescai2016
Params8.05B
Context125K
Q4_K_M4.9 GB
GR
Ibm Granite.Granite 4.2 30b
Granite · DevQuasar
Params29.3B
Context128K
Smallest10.9 GB
GR
Granite 4.0 H Small Heretic_Lo
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
GR
granite embedding 97m multilingual r2
Granite · terminela
Params97M
Context32K
Smallest0.1 GB
GR
Granite 7b Instruct
Granite · DevQuasar-4
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
Granite 3.1 3b A800M T1
Granite · mradermacher
Params3.3B
Context128K
Q4_K_M2.0 GB