Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
granite speech 4.0 1b
Granite · cstr
Params2.31B
Context—
Smallest2.9 GB
GGUF
GR
Ibm Granite_Granite 4.0 Micro
Granite · lmstudio-community
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
granite-7b-lab
Granite · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GR
Models Ibm Granite Granite 3.0 2b Instruct
Granite · MaziyarPanahi
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
GR
Ektome granite 3.0 8b instruct PristinelyUncensored
Granite · Zynerji
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.0 H 32A9B Creative v1.1
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
Tool use
GR
Granite 4.2 8b Decensored
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite 4.1 30b
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
Tool use
GR
Huihui Granite 4.1 8b Abliterated
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Granite 34b Code Instruct 8k
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
CodingTool use
GR
Granite 4.2 8B BE
Granite · taronaeo
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
GR
granite-8b-code-instruct
Granite · SanctumAI
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
GR
granite-3b-code-glaive-20k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
granite 4.2 8b heretic
Granite · richardyoung
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite Vision 3.2 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 3.3 2B Instruct BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.0 H Tiny BE
Granite · taronaeo
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
GR
granite vision 3.2 2b
Granite · ibm-research
Params2.53B
Context16K
Q4_K_M1.5 GB
Tool useVision
GR
Ibm Granite_Granite 4.1 3b
Granite · lmstudio-community
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
IBM_granite 4.1 30b_Abliterated
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
GGUF
GR
Parable Granite 4.1 8B Claude Fable 5
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
ReasoningTool use
GR
Granite 4.1 30b Abliterated
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
Tool use
GR
huihui ai.granite vision 3.2 2b abliterated
Granite · DevQuasar-5
Params2.53B
Context16K
Q4_K_M1.5 GB
Tool useVision
GR
Granite 4.0 3B Vision BE
Granite · taronaeo
Params3.66B
Context128K
Q4_K_M2.2 GB
GGUF
GR
Granite 20b Code Instruct 8k
Granite · RichardErkhov
Params20.1B
Context8K
Q4_K_M12.8 GB
Coding
GR
granite 4.2 3b heretic
Granite · richardyoung
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
Granite Vision 4.1 4B BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Kiesel v2
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite Guardian 3.1 2b
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
granite 3.0 1b a400m instruct
Granite · QuantFactory
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use

Keep browsing