Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 3b Code Base 128k
Granite · RichardErkhov
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
GR
Granite 4.0 350m
Granite · ibm-granite
Params352M
Context32K
Q4_K_M0.2 GB
GGUF
GR
Granite 4.0 H 1B BE
Granite · taronaeo
Params1.46B
Context—
Q4_K_M0.9 GB
GGUF
GR
granite-3b-code-base
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
Granite 4.2 3b
Granite · bartowski
Params3.66B
Context128K
Q4_K_M2.3 GB
ReasoningTool use
GR
Granite 7b Base
Granite · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GR
Granite Speech 5.0 2b
Granite · ibm-granite
Params1.84B
Context16K
Q4_K_M1.1 GB
Vision
GR
granite-8b-code-instruct
Granite · ibm-granite
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
GR
Granite Guardian 4.1 8b
Granite · ibm-granite
Params8.38B
Context128K
Q4_K_M5.1 GB
ReasoningTool use
GR
Granite 8b Code Instruct 4k
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
GR
Granite 8b Code Instruct
Granite · duyntnet
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
GR
Granite 4.2 30b
Granite · bartowski
Params29.3B
Context128K
Q4_K_M18.0 GB
ReasoningTool use
GR
Granite 3b Code Instruct 128k
Granite · RichardErkhov
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
GR
Granite 4.0 H Small
Granite · bartowski
Params32.2B
Context1024K
Q4_K_M19.7 GB
GGUF
GR
granite 4.2 8b heretic
Granite · saidutta69
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplayTool use
GR
Granite 3.1 3b A800M Instruct
Granite · bartowski
Params3.3B
Context128K
Q4_K_M2.0 GB
GGUF
GR
Granite 8b Code Base 4k
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
GR
Granite 3b Code Base
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
Granite 3b Code Instruct 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
GR
Granite 3.2 8b Instruct
Granite · bartowski
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite-4.0-Micro
Granite · unsloth
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite-4.0-H-1B
Granite · unsloth
Params1.46B
Context1024K
Q4_K_M0.9 GB
GGUF
GR
Huihui Granite 4.1 3b Abliterated
Granite · huihui-ai
Params3.4B
Context128K
Smallest6.8 GB
GGUF
GR
granite 4.2 3b heretic
Granite · saidutta69
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningRoleplayTool use
GR
Granite 8b Code Base
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
GR
granite embedding 125m english
Granite · bartowski
Params124M
Context512
Q4_K_M0.1 GB
Embedding
GR
granite 3.1 2b instruct
Granite · QuantFactory
Params2.63B
Context128K
Q4_K_M1.6 GB
GGUF
GR
granite speech 4.1 2b
Granite · cstr
Params2.31B
Context—
Smallest1.8 GB
GGUF
GR
Granite 3.0 8b Lab Community
Granite · bartowski
Params8.17B
Context4K
Q4_K_M4.9 GB
GGUF
GR
granite-3b-code-base
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding

Keep browsing