Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.1 3b
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 3.0 3b A800M Base
Granite · RichardErkhov
Params3.37B
Context4K
Q4_K_M2.1 GB
GGUF
GR
Huihui Granite 4.1 3b Abliterated
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
granite 4.2 3b MXFP4A16 GPTQ
Granite · quark75
Params3.66B
Context128K
Smallest2.7 GB
ReasoningTool use
GR
Granite 20b Code Instruct 8k
Granite · DevQuasar-2
Params20.1B
Context8K
Q4_K_M12.8 GB
Coding
GR
Drzeon granite 4 2 8b stem finetune
Granite · ahmetggg
Params8.79B
Context128K
Q4_K_M5.3 GB
CodingReasoningTool use
GR
granite 8b code instruct 128k
Granite · QuantFactory
Params8.05B
Context125K
Q4_K_M4.9 GB
CodingTool use
GR
Granite 3.3 2b Base
Granite · ibm-granite
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.0 1b Base
Granite · mradermacher
Params1.63B
Context128K
Q4_K_M1.0 GB
GGUF
GR
Granite 4.0 H 7b Heretic
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
Tool use
GR
ibm granite.granite vision 3.1 2b preview
Granite · DevQuasar-5
Params2.53B
Context16K
Q4_K_M1.5 GB
Tool useVision
GR
Granite 3.3 8b Instruct
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Granite 3.1 Earthen v0.3 3B A800M
Granite · mradermacher
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
IBM_granite 4.1 3b_Abliterated
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite 4.2 8b Decensored
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite 4.0 H Micro Base
Granite · ibm-granite
Params3.19B
Context1024K
Q4_K_M1.9 GB
GGUF
GR
granite-3.1-8b-lora-intrinsics-v0.1
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.1 2B Instruct BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.0 H 1b
Granite · mrutkows
Params1.46B
Context1024K
Q4_K_M0.9 GB
Tool use
GR
Granite 4.1 3b Abliterated AND Disinhibited
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 3.0 3b A800M Instruct
Granite · RichardErkhov
Params3.37B
Context4K
Q4_K_M2.1 GB
Tool use
GR
Granite 4.0 H Small Base
Granite · ibm-granite
Params32.2B
Context1024K
Q4_K_M19.5 GB
GGUF
GR
granite 3.1 8b Reasoning
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Granite Cermat 7b
Granite · mradermacher
Params6.67B
Context1024K
Q4_K_M4.0 GB
ReasoningTool use
GR
Granite 3.3 2b Instruct
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite 3.1 8b Instruct
Granite · duyntnet
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
granite-4.0-1b
Granite · Mungert
Params1.63B
Context128K
Q4_K_M1.1 GB
Tool use
GR
granite-3.0-8b-lora-intrinsics-v0.1
Granite · Mungert
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
granite-3b-code-instruct-128k
Granite · Mungert
Params3.48B
Context125K
Q4_K_M2.1 GB
CodingTool use
GR
granite 3.0 1b a400m base
Granite · QuantFactory
Params1.33B
Context4K
Q4_K_M0.8 GB
GGUF

Keep browsing