Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 3 Flux Final
Granite · mradermacher
Params8.37B
Context4K
Q4_K_M5.1 GB
Tool use
GR
Granite 4.1 3B Function Calling xLAM Unsloth
Granite · ermiaazarkhalili
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 4.2 30b
Granite · llmware
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GR
Granite 3.0 1b A400M Instruct
Granite · mrutkows
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use
GR
Ibm Granite.Granite 3.1 3b A800M Instruct
Granite · DevQuasar-6
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
Granite 3.1 8b Base
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Ibm Granite.Granite 4.0 H 1b
Granite · DevQuasar
Params1.46B
Context1024K
Q4_K_M0.9 GB
Tool use
GR
Granite 4.1 8b
Granite · bombman
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Granite 4.0 H 32A9B Creative v1.1
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
Tool use
GR
Granite 4.1 8b
Granite · Lauarvik
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Granite 4.2 3b
Granite · llmware
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
Granite 4.2 8b
Granite · llmware
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite 3.1 2b Instruct
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 4.1 8b
Granite · mrutkows
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Ibm Granite.Granite 3.0 1b A400M Instruct
Granite · DevQuasar-3
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use
GR
Granite 4.1 30b Base
Granite · kimi-chan
Params28.9B
Context128K
Q4_K_M17.5 GB
GGUF
GR
Granite Embedding 30m English
Granite · lmstudio-community
Params30M
Context512
Q4_K_M0.0 GB
Embedding
GR
Granite 4.1 Queen 8b
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
RoleplayTool useVision
GR
Granite 3.3 2b Instruct Ethics
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.0 1b Base
Granite · mradermacher
Params1.63B
Context128K
Q4_K_M1.0 GB
GGUF
GR
Granite Guardian 3.2 5b
Granite · mradermacher
Params5.78B
Context128K
Q4_K_M3.5 GB
Tool use
GR
granite-docling-258M
Granite · Mungert
Params164M
Context8K
Q4_K_M0.1 GB
CodingVision
GR
Ibm Granite.Granite 3.1 3b A800M Base
Granite · DevQuasar-6
Params3.3B
Context128K
Q4_K_M2.0 GB
GGUF
GR
Granite 4.0 H Small Heretic_Med
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
Tool use
GR
Granite 3.1 8b Instruct
Granite · mradermacher
Params8.37B
Context128K
Q4_K_M5.1 GB
GGUF
GR
granite 34b code instruct 8k
Granite · ibm-granite
Params33.7B
Context8K
Q4_K_M21.4 GB
CodingTool use
GR
Granite 4.0 H Tiny
Granite · ZuzeTt
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
GR
Granite Docling 258M
Granite · SandLogicTechnologies
Params164M
Context8K
Smallest0.1 GB
Vision
GR
Granite 3.1 2b Instruct Abliterated
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
granite 4.2 3b heretic abliterated
Granite · snellchapo
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use

Keep browsing