Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.0 Tiny Base Preview
Granite · mradermacher
Params6.67B
Context1024K
Q4_K_M4.1 GB
GGUF
GR
Granite_42_30b_Abliterated
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GR
Ibm Granite_Granite 4.0 H Micro
Granite · lmstudio-community
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
GR
Granite 3.3 2b Instruct
Granite · lmstudio-community
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite 3.1 2b Instruct OBLITERATED
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Jarvis granite 4.1 3b finetuned
Granite · roger33303
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 3.3 2B Slerp
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Ibm Granite.Granite 3.1 8b Instruct
Granite · DevQuasar-5
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
granite 3.1 1b a400m concision experiment
Granite · OVRLab
Params1.33B
Context128K
Smallest2.7 GB
Tool use
GR
granite-4.0-h-1b
Granite · Mungert
Params1.46B
Context1024K
Q4_K_M0.9 GB
Tool use
GR
Granite 3.3 2b Hermes3dataset
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite Speech 4.1 2b
Granite · kstorm77
Params1.84B
Context4K
Smallest2.0 GB
Vision
GR
Granite 3.3 2b Base
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.0 H Tiny
Granite · tatsuyaaaaaaa
Params6.94B
Context1024K
Q4_K_M4.2 GB
Tool use
GR
Ibm Granite.Granite 3.1 1b A400M Base
Granite · DevQuasar-6
Params1.33B
Context128K
Q4_K_M0.8 GB
GGUF
GR
Ibm Granite Granite 7b Base
Granite · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
GR
granite-3b-code-base
Granite · ibm-granite
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
Granite 4.2 8b
Granite · webmp3
Params8.79B
Context128K
Smallest3.6 GB
ReasoningTool use
GR
Mordant 3B Think
Granite · Kezmark
Params3.4B
Context128K
Smallest2.8 GB
Reasoning
GR
Ibm Granite.Granite 4.1 30b
Granite · DevQuasar
Params28.9B
Context128K
Q4_K_M17.5 GB
Tool use
GR
Granite 3.0 2b Instruct
Granite · mradermacher
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
GR
Ibm Granite_Granite 4.1 30b
Granite · lmstudio-community
Params28.9B
Context128K
Q4_K_M17.5 GB
Tool use
GR
Ibm Granite.Granite Guardian 3.0 2b
Granite · DevQuasar-10
Params2.53B
Context8K
Q4_K_M1.5 GB
GGUF
GR
Granite 3.3 8b Instruct LogDetective
Granite · mradermacher
Params8.37B
Context128K
Q4_K_M5.1 GB
ReasoningTool use
GR
Granite 4.1 30b Heretic
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
Tool use
GR
Ibm Granite Granite 8b Code Instruct 128k
Granite · tensorblock
Params8.05B
Context125K
Smallest3.1 GB
CodingTool use
GR
granite 3.1 3b a800m base
Granite · QuantFactory
Params3.37B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite Docling 258M
Granite · Userb1az
Params164M
Context8K
Smallest0.2 GB
CodingVision
GR
Granite 3.1 8b Instruct Abliterated
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Ibm Granite.Granite 3.0 2b Instruct
Granite · DevQuasar-5
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use

Keep browsing