Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
granite 4.2 30b
Granite · Omega-Factory
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GR
Granite 4.0 H 350m Unsloth
Granite · magiccodingman
Params340M
Context1024K
Smallest0.4 GB
Tool use
GR
granite 3b code base
Granite · CastawayEGR
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
granite-8b-code-instruct
Granite · ethangoh
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
GR
granite 4.0 h micro aegis content safety
Granite · meet12341234
Params3.19B
Context1024K
Smallest3.4 GB
Tool use
GR
granite 3.1 1b a400m instruct APEX
Granite · Myric
Params1.33B
Context128K
Smallest0.5 GB
Tool use
GR
Granite 4.1 30B Claude 4.6 Opus Thinking Charles Xavier
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GR
Granite Speech 4.1 2B Plus
Granite · epapanita
Params2.11B
Context—
Q4_K_M1.5 GB
GGUF
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_FineWeb.seed1
Granite · DevQuasar-9
Params6.85B
Context8K
Q4_K_M6.0 GB
GGUF
GR
steph speak granite 4.0 h 350M v2
Granite · lsmdx
Params340M
Context1024K
Q4_K_M0.2 GB
Tool use
GR
Granite 3.0 3b A800M Base
Granite · mradermacher
Params3.37B
Context4K
Q4_K_M2.1 GB
GGUF
GR
Granite 3b Code Base 128k
Granite · itlwas
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
GR
granite 4.0 h 350m router kd web4 s0
Granite · martinnavs
Params340M
Context1024K
Q4_K_M0.2 GB
Tool use
GR
Instructlab Granite 7b Lab
Granite · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
GR
Ibm Granite.Granite 4.2 8b
Granite · DevQuasar
Params8.79B
Context128K
Smallest3.4 GB
ReasoningTool use
GR
granite guardian 3.0 8b
Granite · QuantFactory
Params8.17B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Granite Embedding 311m Multilingual R2
Granite · fisher046
Params312M
Context32K
Smallest0.3 GB
Embedding
GR
Ibm Granite Granite 20b Functioncalling
Granite · tensorblock
Params20.1B
Context8K
Smallest7.9 GB
GGUF
GR
Ibm Granite Granite 3.1 2b Instruct
Granite · tensorblock
Params2.53B
Context128K
Smallest1.0 GB
Tool use
GR
granite-8b-code-instruct
Granite · cobrakenji
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
GR
Granite 4.1 8b Brainstone Thinking
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Apriel 1.5 15b Thinker Unsloth
Granite · magiccodingman
Params14.4B
Context256K
Smallest13.1 GB
ReasoningTool useVision
GR
granite-8b-code-instruct
Granite · upendrab
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
GR
Ibm Granite Granite 3.0 1b A400M Instruct
Granite · tensorblock
Params1.33B
Context4K
Smallest0.5 GB
Tool use
GR
Granite 8b Code Instruct 128k
Granite · charlescai2016
Params8.05B
Context125K
Q4_K_M4.9 GB
CodingTool use
GR
Ibm Granite.Granite 4.2 30b
Granite · DevQuasar
Params29.3B
Context128K
Smallest10.9 GB
ReasoningTool use
GR
Granite 4.0 H Small Heretic_Lo
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
Tool use
GR
granite embedding 97m multilingual r2
Granite · terminela
Params97M
Context32K
Smallest0.1 GB
Embedding
GR
Granite 7b Instruct
Granite · DevQuasar-4
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GR
Granite 3.1 3b A800M T1
Granite · mradermacher
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use

Keep browsing