Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
granite 4.0 1b speech
Granite · epapanita
Params2.31B
Context—
Q4_K_M1.6 GB
GGUF
GR
Granite 3.3 2b Instruct
Granite · lm-kit
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite Uncertainty 3.2 8b Lora
Granite · QuantPanda
Params3M
Context—
Smallest0.0 GB
GGUF
GR
Granite 3.0 1b A400M Instruct
Granite · davelsphere
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use
GR
Granite 4.2 8B ICDU Standard v1 DPO
Granite · Gadsdencode
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite 3.3 8b Instruct Apostate
Granite · heterodoxin
Params8.37B
Context128K
Q4_K_M5.1 GB
GGUF
GR
Ibm Granite Granite 3b Code Instruct 128k
Granite · tensorblock
Params3.48B
Context125K
Smallest1.3 GB
CodingTool use
GR
granite4.1 8b Q4 K M
Granite · amidblue
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
granite speech 5.0 470m turboctc nc Q8 0
Granite · superflow-hq
Params470M
Context—
Smallest0.5 GB
GGUF
GR
Granite 4.2 8b
Granite · lin7c
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite 3.3 2b Instruct
Granite · ZeroWw
Params2.53B
Context128K
Smallest1.6 GB
ReasoningTool use
GR
granite 4.2 3b Q4 K M imatrix
Granite · quark75
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
granite-3b-code-instruct
Granite · YorkieOH10
Params3.48B
Context2K
Smallest3.7 GB
CodingTool use
GR
Granite 4.1 3b Base
Granite · Beinsezii
Params3.4B
Context128K
Smallest3.6 GB
GGUF
GR
Granite 4.1 8b
Granite · NikolayKozloff
Params8.79B
Context128K
Smallest9.3 GB
GGUF
GR
Ibm Granite Granite 3.1 2b Base
Granite · tensorblock
Params2.53B
Context128K
Smallest1.0 GB
GGUF
GR
Granite 4.1 8B Power
Granite · librepowerai
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
GR
qmd query expansion granite 2b grpo
Granite · nichenke
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite 3.0 8b Instruct
Granite · osllmai
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.0 H Tiny
Granite · lm-kit
Params6.94B
Context1024K
Q4_K_M4.2 GB
Tool use
GR
Granite 4.0 H Micro
Granite · professorf
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
GR
lumynax infused granite31 1b a400m
Granite · AbteeXAILab
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
GR
Granite Embedding
Granite · arshvir
Params312M
Context32K
Smallest0.6 GB
Embedding
GR
tiny random granite moe i1
Granite · mradermacher
Params3M
Context4K
Q4_K_M0.0 GB
Tool use
GR
Granite 3.1 2b Instruct
Granite · Lucy-in-the-Sky
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Ibm Granite Granite 20b Code Base R1.1
Granite · tensorblock
Params20.1B
Context8K
Smallest7.9 GB
CodingReasoning
GR
Granite 4.0 H Tiny
Granite · KavinduHansaka
Params6.94B
Context1024K
Smallest4.0 GB
Tool use
GR
Granite Speech 4.1 2B NAR
Granite · myflow-ai
Params2.25B
Context—
Smallest1.8 GB
GGUF
GR
granite 4.0 1b speech
Granite · myflow-ai
Params2.31B
Context—
Smallest1.8 GB
GGUF
GR
granite-4.2-8b
Granite · kingjones777
Params8.79B
Context128K
Smallest9.1 GB
ReasoningTool use

Keep browsing