Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
lumynax infused granite33 2b
Granite · AbteeXAILab
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite 3.1 1b A400M Base
Granite · elichen-skymizer
Params1.33B
Context128K
Smallest0.7 GB
GGUF
GR
Ibm Granite Granite 3.0 8b Base
Granite · tensorblock
Params8.17B
Context4K
Smallest3.1 GB
GGUF
GR
precis
Granite · cernis-intelligence
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
GR
ilab granite
Granite · Ifraaaa
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GR
Granite Speech 5.0 470M TurboCTC
Granite · ashbash
Params473M
Context—
Smallest0.9 GB
GGUF
GR
Granite 3.1 2b Instruct
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 3.3 Conversations
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.1 2b Instruct
Granite · Lucy-in-the-Sky
Params2.53B
Context128K
Smallest2.1 GB
Tool use
GR
Orb Human Typeahead 350m v1
Granite · chartreuse-verte
Params352M
Context32K
Smallest0.4 GB
Roleplay
GR
Qiskit.granite 8b Qiskit Rc 0.10
Granite · DevQuasar
Params8.05B
Context4K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.1 3b
Granite · phoenix-gurl
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite 4.1 3B SFT Fable5 Glint
Granite · ermiaazarkhalili
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 3.2 8b Instruct
Granite · BernTheCreator
Params8.17B
Context128K
Smallest4.7 GB
Tool use
GR
Granite 3.3 2b Instruct Literary Writer v0.1
Granite · PJRM
Params2.53B
Context128K
Smallest1.5 GB
GGUF
GR
ibm granite 4 0 3b
Granite · cPilotGod
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
GR
granite 20b code instruct
Granite · coder543
Params20.1B
Context8K
Smallest11.6 GB
Coding
GR
Ibm Granite Granite 3.1 3b A800M Instruct
Granite · tensorblock
Params3.3B
Context128K
Smallest1.2 GB
Tool use
GR
Granite 3.1 2b Instruct
Granite · ZeroWw
Params2.53B
Context128K
Smallest1.6 GB
Tool use
GR
granite 8b code instruct Q5 K M
Granite · Sagicc
Params8.05B
Context4K
Smallest5.6 GB
CodingTool use
GR
Ibm Granite Granite 3.1 1b A400M Instruct
Granite · tensorblock
Params1.33B
Context128K
Smallest0.5 GB
Tool use
GR
Granite Swash 3b A600M
Granite · emredeveloper
Params3.02B
Context8K
Smallest6.0 GB
GGUF
GR
Granite Speech 4.1 2B Plus
Granite · myflow-ai
Params2.11B
Context—
Smallest1.7 GB
GGUF
GR
Granite Speech 4.1 2B Plus
Granite · voicetide
Params2.11B
Context—
Smallest1.7 GB
GGUF
GR
Granite 3.3 2b Reviser
Granite · sillykiwi
Params2.53B
Context128K
Smallest2.7 GB
Vision
GR
granite-8b-code-base
Granite · NikolayKozloff
Params8.05B
Context4K
Smallest8.6 GB
Coding
GR
Granite 4.0 H 1b
Granite · jerkar
Params1.46B
Context1024K
Smallest1.6 GB
Tool use
GR
Iq Code Evmind v3.1 Granite 8b Instruct All
Granite · rovnerivan
Params8.05B
Context4K
Smallest4.4 GB
Coding
GR
granite 34b code instruct Q8 0
Granite · YorkieOH10
Params33.7B
Context8K
Smallest35.9 GB
CodingTool use
GR
granite 34b code base Q8 0
Granite · YorkieOH10
Params33.7B
Context8K
Smallest35.9 GB
Coding

Keep browsing