Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.1 3b Heretic
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Ibm Granite Granite 8b Code Base 4k
Granite · tensorblock
Params8.05B
Context4K
Smallest3.1 GB
Coding
GR
granite 8b rpgle
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
GGUF
GR
Ibm Granite Granite 3b Code Base 2k
Granite · tensorblock
Params3.48B
Context2K
Smallest1.3 GB
Coding
GR
Granite 3.0 2b Instruct
Granite · duyntnet
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
GR
Granite 3.1 2b Instruct
Granite · lmstudio-community
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 20b Code Instruct R1.1
Granite · mradermacher
Params20.1B
Context8K
Q4_K_M12.8 GB
CodingReasoningTool use
GR
Granite 4.0 Micro Heretic Uncensored
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
granite-3.1-3b-a800m-instruct
Granite · Mungert
Params3.3B
Context128K
Smallest1.2 GB
Tool use
GR
Granite 4.0 H Small Heretic_Hi
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
Tool use
GR
Ibm Granite.Granite 4.0 H Small
Granite · DevQuasar
Params32.2B
Context1024K
Q4_K_M19.5 GB
Tool use
GR
Granite Guardian 3.2 3b A800M
Granite · mradermacher
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
Granite 4.1 8b Apostate
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
granite 3.0 8b base
Granite · QuantFactory
Params8.17B
Context4K
Q4_K_M4.9 GB
GGUF
GR
Granite 3.1 2b Base
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 3.2 2b Instruct
Granite · lmstudio-community
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Ibm Granite_Granite 4.0 H Small
Granite · lmstudio-community
Params32.2B
Context1024K
Q4_K_M19.5 GB
Tool use
GR
Ibm Granite Granite 3.1 8b Instruct
Granite · tensorblock
Params8.17B
Context128K
Smallest3.1 GB
Tool use
GR
Ibm Granite.Granite 3.1 2b Instruct
Granite · DevQuasar-6
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 3.3 2b Instruct
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite Guardian 3.1 8b
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite Guardian 3.0 2b
Granite · RichardErkhov
Params2.53B
Context8K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.2 3B Uncensored Conversational
Granite · minas2025
Params3.66B
Context128K
Smallest3.0 GB
ReasoningTool use
GR
Ibm Granite.Granite 3.0 8b Instruct
Granite · DevQuasar-8
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.1 1b A400M Instruct
Granite · mrutkows
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
GR
Granite 3.2 8b Instruct
Granite · CISCai
Params8.17B
Context128K
Smallest1.8 GB
CodingTool use
GR
MoE Girl 400MA 1BT
Granite · QuantFactory
Params1.33B
Context8K
Q4_K_M0.8 GB
Roleplay
GR
Granite 3.1 8b Instruct
Granite · mradermacher
Params8.37B
Context128K
Q4_K_M5.1 GB
GGUF
GR
Granite Guardian 3.3 8b
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.1 8b Abliterated
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
Tool use

Keep browsing