Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
lumynax infused granite33 2b
Granite · AbteeXAILab
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 3.1 1b A400M Base
Granite · elichen-skymizer
Params1.33B
Context128K
Smallest0.7 GB
GR
Ibm Granite Granite 3.0 8b Base
Granite · tensorblock
Params8.17B
Context4K
Smallest3.1 GB
GR
precis
Granite · cernis-intelligence
Params3.19B
Context1024K
Q4_K_M1.9 GB
GR
ilab granite
Granite · Ifraaaa
Params6.74B
Context2K
Q4_K_M4.1 GB
GR
Granite Speech 5.0 470M TurboCTC
Granite · ashbash
Params473M
Context—
Smallest0.9 GB
GR
Granite 3.1 2b Instruct
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 3.3 Conversations
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite 3.1 2b Instruct
Granite · Lucy-in-the-Sky
Params2.53B
Context128K
Smallest2.1 GB
GR
Orb Human Typeahead 350m v1
Granite · chartreuse-verte
Params352M
Context32K
Smallest0.4 GB
GR
Qiskit.granite 8b Qiskit Rc 0.10
Granite · DevQuasar
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite 4.1 3b
Granite · phoenix-gurl
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 4.1 3B SFT Fable5 Glint
Granite · ermiaazarkhalili
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 3.2 8b Instruct
Granite · BernTheCreator
Params8.17B
Context128K
Smallest4.7 GB
GR
Granite 3.3 2b Instruct Literary Writer v0.1
Granite · PJRM
Params2.53B
Context128K
Smallest1.5 GB
GR
ibm granite 4 0 3b
Granite · cPilotGod
Params3.19B
Context1024K
Q4_K_M1.9 GB
GR
granite 20b code instruct
Granite · coder543
Params20.1B
Context8K
Smallest11.6 GB
GR
Ibm Granite Granite 3.1 3b A800M Instruct
Granite · tensorblock
Params3.3B
Context128K
Smallest1.2 GB
GR
Granite 3.1 2b Instruct
Granite · ZeroWw
Params2.53B
Context128K
Smallest1.6 GB
GR
granite 8b code instruct Q5 K M
Granite · Sagicc
Params8.05B
Context4K
Smallest5.6 GB
GR
Ibm Granite Granite 3.1 1b A400M Instruct
Granite · tensorblock
Params1.33B
Context128K
Smallest0.5 GB
GR
Granite Swash 3b A600M
Granite · emredeveloper
Params3.02B
Context8K
Smallest6.0 GB
GR
Granite Speech 4.1 2B Plus
Granite · myflow-ai
Params2.11B
Context—
Smallest1.7 GB
GR
Granite Speech 4.1 2B Plus
Granite · voicetide
Params2.11B
Context—
Smallest1.7 GB
GR
Granite 3.3 2b Reviser
Granite · sillykiwi
Params2.53B
Context128K
Smallest2.7 GB
GR
granite-8b-code-base
Granite · NikolayKozloff
Params8.05B
Context4K
Smallest8.6 GB
GR
Granite 4.0 H 1b
Granite · jerkar
Params1.46B
Context1024K
Smallest1.6 GB
GR
Iq Code Evmind v3.1 Granite 8b Instruct All
Granite · rovnerivan
Params8.05B
Context4K
Smallest4.4 GB
GR
granite 34b code instruct Q8 0
Granite · YorkieOH10
Params33.7B
Context8K
Smallest35.9 GB
GR
granite 34b code base Q8 0
Granite · YorkieOH10
Params33.7B
Context8K
Smallest35.9 GB