Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
granite guardian 4.1 8b i1
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
Tool use
GR
Granite 3.3 2b Instruct Ethics
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.2 3B Surgical Abliterated
Granite · medismera
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
granite 3.1 2b base
Granite · QuantFactory
Params2.63B
Context128K
Q4_K_M1.6 GB
GGUF
GR
IBM_granite 4.1 3b_Abliterated
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite 4.0 H Tiny Adaptive Reasoning
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
ReasoningTool use
GR
Granite 4.1 3b
Granite · mrutkows
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Ibm Granite.Granite 3.2 8b Instruct
Granite · DevQuasar-9
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.1 8B Function Calling xLAM Unsloth
Granite · ermiaazarkhalili
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
granite-3b-code-base-2k
Granite · Mungert
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
Iq Code Evmind v1 Granite 8b Instruct
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
GR
Ibm Granite.Granite 8b Code Instruct 4k
Granite · DevQuasar-8
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
GR
Granite 3.1 3b A800M Instruct
Granite · lmstudio-community
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
Granite 4.1 3B Abliterated
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
granite 4.0 h micro DISTILL OPUS 4.5 think
Granite · glogwa68
Params3.4B
Context1024K
Q4_K_M2.1 GB
Reasoning
GR
granite-20b-functioncalling
Granite · Mungert
Params20.1B
Context8K
Q4_K_M12.6 GB
GGUF
GR
Ibm Granite.Granite 3.0 3b A800M Base
Granite · DevQuasar-8
Params3.37B
Context4K
Q4_K_M2.1 GB
GGUF
GR
granite 3.0 8b instruct
Granite · QuantFactory
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.0 1b A400M Base
Granite · RichardErkhov
Params1.38B
Context4K
Q4_K_M0.9 GB
GGUF
GR
granite-guardian-3.1-2b
Granite · Mungert
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 4.1 3b Hardened
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 3.0 1b A400M Base
Granite · mrutkows
Params1.38B
Context4K
Q4_K_M0.9 GB
GGUF
GR
Ektome Granite 3.0 8b Instruct PristinelyUncensored
Granite · mradermacher
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
TwIL-LM3-Pro
Granite · Neurona
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
granite 3.1 1b a400m concision
Granite · ziaddddd
Params1.33B
Context128K
Smallest2.7 GB
Tool use
GR
IBM Granite 4.1 8b Heretic
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
Tool use
GR
granite 4.1 3b DASHQ Q2
Granite · jkim96
Params3.4B
Context128K
Smallest1.0 GB
Tool use
GR
granite 3.1 1b a400m base
Granite · QuantFactory
Params1.38B
Context128K
Q4_K_M0.9 GB
GGUF
GR
Granite 3.1 1b A400M Base
Granite · mradermacher
Params1.33B
Context128K
Q4_K_M0.8 GB
GGUF
GR
Granite 4.0 H Micro
Granite · mrutkows
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use

Keep browsing