Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.0 Tiny Base Preview
Granite · elichen-skymizer
Params6.67B
Context1024K
Smallest3.2 GB
GGUF
GR
granite 3.1 8b instruct KW2
Granite · rios1
Params8.37B
Context128K
Q4_K_M5.1 GB
Tool use
GR
granite 3.1 8b instruct
Granite · ticlazau
Params8.17B
Context128K
Smallest8.7 GB
Tool use
GR
Granite 3.0 8b Base
Granite · davelsphere
Params8.17B
Context4K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.1 30b
Granite · viniciusianni
Params28.9B
Context128K
Q4_K_M17.5 GB
GGUF
GR
Granite 4.1 8b
Granite · IHaveNoClueAndIMustPost
Params8.79B
Context128K
Smallest7.2 GB
GGUF
GR
Ibm Granite Granite Guardian 3.0 8b
Granite · tensorblock
Params8.17B
Context8K
Smallest3.1 GB
GGUF
GR
Granite 3.1 8b Instruct
Granite · Lucy-in-the-Sky
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.0 3b A800M Instruct
Granite · mrutkows
Params3.37B
Context4K
Q4_K_M2.1 GB
Tool use
GR
Granite-4.0-H-Small
Granite · noctrex
Params32.2B
Context1024K
Smallest19.8 GB
Tool use
GR
granite-8b-code-instruct
Granite · NikolayKozloff
Params8.05B
Context4K
Smallest6.6 GB
CodingTool use
GR
Granite 3.0 3b A800M Base
Granite · mrutkows
Params3.37B
Context4K
Q4_K_M2.1 GB
GGUF
GR
Granite 4.2 3B ArkCompact Q4 K M
Granite · Ooriginador
Params3.66B
Context128K
Q4_K_M2.3 GB
GGUF
GR
Granite 3.1 3b A800M Instruct
Granite · PJRM
Params3.3B
Context128K
Smallest1.9 GB
Tool use
GR
sidekick cortex pro
Granite · lastbrowser
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
Granite Guardian 3.1 2b
Granite · ktoprakucar
Params2.53B
Context128K
Smallest2.7 GB
Tool use
GR
meta granite 3.3 8b instruct
Granite · Imperius
Params92M
Context—
Smallest0.4 GB
GGUF
GR
granite embedding english r2 gguf q8 0
Granite · keisuke-miyako
Params149M
Context8K
Smallest0.2 GB
Embedding
GR
Granite 3.3 8b Creative
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Granite 3.0 2b Instruct
Granite · aashish1904
Params2.63B
Context4K
Smallest2.8 GB
Tool use
GR
Granite 3.0 8b Instruct
Granite · davelsphere
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.2 8b Instruct
Granite · ObeJ
Params8.17B
Context128K
Smallest8.7 GB
Tool use
GR
granite embedding 311m multilingual r2
Granite · atfai
Params312M
Context32K
Smallest0.6 GB
Embedding
GR
Orb Human Typeahead 350m v1.1
Granite · chartreuse-verte
Params352M
Context32K
Smallest0.4 GB
RoleplayTool use
GR
granite vision 3.3 2b chart2csv preview
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool useVision
GR
Granite 4.0 1b
Granite · YorkieOH10
Params1.63B
Context128K
Smallest1.7 GB
GGUF
GR
Granite4.0 Gita FT
Granite · bajrangCoder
Params3.19B
Context1024K
Smallest1.2 GB
CodingTool use
GR
Granite 8b Qiskit
Granite · Qiskit
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
GR
Granite 3.1 3b A800M Instruct
Granite · ZeroWw
Params3.3B
Context128K
Smallest2.0 GB
Tool use
GR
Granite 4.1 8b
Granite · kingjones777
Params8.79B
Context128K
Smallest5.2 GB
Tool use

Keep browsing