Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.1 3B Medical_Reasoning
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
ReasoningTool use
GR
Granite 4.1 3b Coder
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
CodingTool use
GR
granite-4.2-8b
Granite · vultr
Params8.79B
Context128K
Q4_K_M5.8 GB
ReasoningTool use
GR
Granite 4.1 8b Claude Opus 4.6 Thinking MAX Hf
Granite · Tivaphraen
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite 3.3 2b Finetuned Alpaca Hindi_Full
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.0 H Tiny
Granite · Myric
Params6.94B
Context1024K
Smallest4.7 GB
Tool use
GR
Granite 4.1 3B Function Calling xLAM Unsloth
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Vetta Granite 2b Packaged v3
Granite · mradermacher
Params2.53B
Context4K
Q4_K_M1.5 GB
Tool use
GR
ibm granite.granite vision 3.2 2b
Granite · DevQuasar-5
Params2.53B
Context16K
Q4_K_M1.5 GB
Tool useVision
GR
Granite 3b Code Instruct 128k
Granite · mradermacher
Params3.48B
Context125K
Q4_K_M2.1 GB
CodingTool use
GR
Granite 3.0 8b Instruct
Granite · mradermacher
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
granite 3.1 2b Reasoning
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite 3.2 8b Instruct Preview
Granite · tensorblock
Params8.17B
Context128K
Smallest3.1 GB
Tool use
GR
Granite 3.1 2b Base
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Ibm Granite Granite 3.1 1b A400M Base
Granite · tensorblock
Params1.33B
Context128K
Smallest0.5 GB
GGUF
GR
granite-20b-code-base-r1.1
Granite · Mungert
Params20.1B
Context8K
Q4_K_M12.6 GB
CodingReasoning
GR
Granite 3.0 1b A400M Instruct
Granite · lmstudio-community
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use
GR
Granite 3.1 Earthen v0.3 1B A400M
Granite · mradermacher
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
GR
Granite Guardian 4.0 3b Toxicity Ja
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
granite vision 3.3 2b chart2csv preview
Granite · ibm-granite
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool useVision
GR
granite-3.0-3b-a800m-base
Granite · Mungert
Params3.37B
Context4K
Smallest1.2 GB
GGUF
GR
Granite 4.0 Micro Heretic
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Huihui Granite 4.0 Micro Abliterated
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 3.3 8b Instruct
Granite · lmstudio-community
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Granite 3.1 Earthen v0.3 3B A800M
Granite · mradermacher
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
granite 3.3 2b uncensored
Granite · arzaan789
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite 3.1 8b Instruct
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
granite-3.1-3b-a800m-base
Granite · Mungert
Params3.3B
Context128K
Smallest1.2 GB
GGUF
GR
Granite 4.1 3B SFT Claude Opus Reasoning Unsloth
Granite · ermiaazarkhalili
Params3.4B
Context128K
Q4_K_M2.1 GB
ReasoningTool use
GR
granite 3.1 3b a800m instruct
Granite · QuantFactory
Params3.37B
Context128K
Q4_K_M2.1 GB
Tool use

Keep browsing