Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Ibm Granite Granite 20b Code Base 8k
Granite · tensorblock
Params20.1B
Context8K
Smallest7.9 GB
Coding
GR
prestigeAI 7b granite
Granite · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
GR
Granite 4.0 H Tiny
Granite · MichielBuisman
Params6.94B
Context1024K
Smallest4.2 GB
Tool use
GR
granite 20b code instruct Q4 K M
Granite · mayank-mishra
Params20.1B
Context8K
Q4_K_M12.8 GB
CodingTool use
GR
granite-4.0-micro
Granite · Mungert
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 4.2 8b
Granite · gguf
Params8.79B
Context128K
Q4_K_M5.5 GB
ReasoningTool use
GR
Ibm Granite Granite Guardian 3.2 5b
Granite · tensorblock
Params5.78B
Context128K
Smallest2.2 GB
Tool use
GR
Granite Guardian 3.1 2b
Granite · shawn1251
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite Speech 4.1 2B
Granite · epapanita
Params2.31B
Context—
Q4_K_M1.6 GB
GGUF
GR
granite 20b code base
Granite · cobrakenji
Params20.1B
Context8K
Q4_K_M12.8 GB
Coding
GR
granite 34b code instruct Q4 K M
Granite · cobrakenji
Params33.7B
Context8K
Q4_K_M21.3 GB
CodingTool use
GR
Granite 3b Code Instruct 128k
Granite · itlwas
Params3.48B
Context125K
Q4_K_M2.1 GB
CodingTool use
GR
Orb Human Typeahead 1b v2
Granite · chartreuse-verte
Params1.63B
Context128K
Smallest1.0 GB
RoleplayTool use
GR
Granite 8b Code Instruct 128k
Granite · TobDeBer
Params8.05B
Context125K
Q4_K_M4.9 GB
CodingTool use
GR
granite 3.1 8b base
Granite · QuantFactory
Params8.37B
Context128K
Q4_K_M5.1 GB
GGUF
GR
FFT IBM Granite 4.0 Micro
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
granite speech emotion 1b
Granite · Grunder
Params1.84B
Context4K
Q4_K_M1.1 GB
CodingVision
GR
granite-8b-code-instruct
Granite · cpellens
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
GR
granite 34b code instruct Q4 K M
Granite · hiddenblue1
Params33.7B
Context8K
Q4_K_M21.4 GB
CodingTool use
GR
PSGER 180225 Granite 3.1 2b Instruct
Granite · mradermacher
Params2.63B
Context128K
Q4_K_M1.6 GB
Tool use
GR
granite 3.0 8b lora intrinsics v0.1
Granite · mradermacher
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
granite speech 3.3 2b
Granite · cstr
Params3.11B
Context—
Smallest3.4 GB
GGUF
GR
granite 3b code bedrock ti
Granite · pacohub
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
Granite 3.1 3b A800M Instruct
Granite · Briko
Params3.3B
Context128K
Smallest1.3 GB
Tool use
GR
Granite 4.0 H Micro
Granite · MichielBuisman
Params3.19B
Context1024K
Smallest1.9 GB
Tool use
GR
Granite Docling 258M
Granite · vonjack
Params164M
Context8K
Smallest0.2 GB
Vision
GR
Granite 4.2 3b
Granite · Cyronius
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
dragon granite 8b
Granite · llmware
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
granite 4.1 8b base
Granite · Anthonyg5005
Params8.38B
Context128K
Smallest0.0 GB
GGUF
GR
Granite 3.1 2b Base
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF

Keep browsing