Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.2 3b Heretic
Granite · mradermacher
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
Granite 4.0 Micro
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 3b Code Instruct 128k
Granite · DevQuasar-5
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
GR
granite-3.0-8b-instruct
Granite · Mungert
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.0 H Micro
Granite · mradermacher
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
GR
Kittylm Granite 4.2 3b Thinkbal Hf
Granite · KittyLM
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
granite-3.2-2b-instruct
Granite · Mungert
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Ibm Granite.Granite Guardian 3.2 3b A800M
Granite · DevQuasar-11
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
Granite 4.1 8B SFT Claude Opus Reasoning Unsloth
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite 4.1 8B SFT Claude Opus Reasoning Unsloth
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
ibm-granite/granite-3.3-8b-instruct
Granite · DevQuasar-12
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Granite 3.3 8b Instruct Abliterated
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Ibm Granite.Granite 3b Code Instruct 2k
Granite · DevQuasar-7
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
Granite 4.0 H Small Heretic_Hi
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
Tool use
GR
granite-guardian-3.0-8b
Granite · Mungert
Params8.17B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.1 30b
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
Tool use
GR
Granite Speech 4.1 2b
Granite · mradermacher
Params1.84B
Context4K
Q4_K_M1.1 GB
Vision
GR
Ektome Granite 3.0 8b Instruct PristinelyUncensored
Granite · mradermacher
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Ibm Granite.Granite 3.0 8b Base
Granite · DevQuasar-7
Params8.17B
Context4K
Q4_K_M4.9 GB
GGUF
GR
Granite4.1 8B Heretic
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
Tool use
GR
Granite 4.0 H Tiny
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
Tool use
GR
Granite 34b Code Instruct 8k
Granite · DevQuasar-4
Params33.7B
Context8K
Q4_K_M21.4 GB
Coding
GR
Model Ibm Granite Granite 3.1 2b Instruct Cache
Granite · Alcoft
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Ibm Granite.Granite 8b Code Instruct 128k
Granite · DevQuasar-7
Params8.05B
Context125K
Q4_K_M4.9 GB
Coding
GR
granite-4.0-h-tiny
Granite · Mungert
Params6.94B
Context1024K
Q4_K_M4.3 GB
Tool use
GR
Granite 3.2 8b Instruct
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Models Ibm Granite Granite 3.0 8b Instruct
Granite · MaziyarPanahi
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.2 30B Fable Distill
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GR
Model Ibm Granite Granite 3.1 1b A400M Instruct Cache
Granite · Alcoft
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
GR
Granite 3.3 8b Creative
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use

Keep browsing