GGUF models by ibm-granite

48 GGUF models quantized by ibm-granite on Hugging Face. Sizes run from 164M to 33.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.2 3b
Granite · ibm-granite
Params3.66B
Context128K
Q4_K_M2.2 GB
GGUF
GR
Granite 4.2 8b
Granite · ibm-granite
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
GR
Granite 4.2 30b
Granite · ibm-granite
Params29.3B
Context128K
Q4_K_M17.7 GB
GGUF
GR
Granite 4.1 8b
Granite · ibm-granite
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
GR
Granite 4.1 3b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite 4.0 H Tiny
Granite · ibm-granite
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
GR
Granite 4.0 H Micro
Granite · ibm-granite
Params3.2B
Context1024K
Q4_K_M1.9 GB
GGUF
GR
Granite 4.0 Micro
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite Vision 4.1 4b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
Vision
GR
Granite 3.3 8b Instruct
Granite · ibm-granite
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.0 H Small
Granite · ibm-granite
Params32.2B
Context1024K
Q4_K_M19.5 GB
GGUF
GR
Granite 3.3 2b Instruct
Granite · ibm-granite
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.0 1b
Granite · ibm-granite
Params1.63B
Context128K
Q4_K_M1.0 GB
GGUF
GR
Granite 4.0 H 350m
Granite · ibm-granite
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
GR
Granite 4.0 H 1b
Granite · ibm-granite
Params1.46B
Context1024K
Q4_K_M0.9 GB
GGUF
GR
Granite 4.0 350m
Granite · ibm-granite
Params352M
Context32K
Q4_K_M0.2 GB
GGUF
GR
Granite Speech 5.0 2b
Granite · ibm-granite
Params1.84B
Context16K
Q4_K_M1.1 GB
Vision
GR
granite-8b-code-instruct
Granite · ibm-granite
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
GR
Granite Guardian 4.1 8b
Granite · ibm-granite
Params8.38B
Context128K
Q4_K_M5.1 GB
ReasoningTool use
GR
Granite Switch 4.1 8b
Granite · ibm-granite
Params8.97B
Context128K
Q4_K_M6.4 GB
Tool use
GR
Granite Switch 4.1 30b
Granite · ibm-granite
Params30.6B
Context128K
Q4_K_M21.0 GB
Tool use
GR
Granite Guardian 3.3 8b
Granite · ibm-granite
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.1 30b
Granite · ibm-granite
Params28.9B
Context128K
Q4_K_M17.5 GB
GGUF
GR
Granite 4.0 350m Base
Granite · ibm-granite
Params352M
Context32K
Q4_K_M0.2 GB
GGUF
GR
granite vision 3.3 2b
Granite · ibm-granite
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool useVision
GR
Granite Speech 4.1 2b
Granite · ibm-granite
Params1.84B
Context4K
Q4_K_M1.1 GB
Vision
GR
Granite Docling 258M
Granite · ibm-granite
Params164M
Context8K
Smallest0.3 GB
Vision
GR
Granite 4.0 Micro Base
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite 4.0 H 1b Base
Granite · ibm-granite
Params1.46B
Context1024K
Q4_K_M0.9 GB
GGUF
GR
Granite 4.0 1b Base
Granite · ibm-granite
Params1.63B
Context128K
Q4_K_M1.0 GB
GGUF

About ibm-granite on Hugging Face

ibm-granite has published 48 GGUF models that ggufmodels.com tracks, across families such as Granite. The most downloaded are Granite 4.2 3b, Granite 4.2 8b and Granite 4.2 30b.

The quants ibm-granite publishes most often are Q4_K_M (47), Q8_0 (39), Q6_K (39) and Q5_K_M (39). Their Q4_K_M files range from 0.2 to 21.4 GB. Parameter counts run from 164M to 33.7B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has ibm-granite published?

48 models are listed here, mainly from the Granite families. The most downloaded is Granite 4.2 3b.

Which quants does ibm-granite publish?

The most common are Q4_K_M (47 models), Q8_0 (39 models), Q6_K (39 models) and Q5_K_M (39 models).

Keep browsing