Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · mradermacher
Params3.19B
Context1024K
Q4_K_M1.9 GB
GR
Granite 3.0 8b Instruct
Granite · RichardErkhov
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
Granite 20b Code Base R1.1
Granite · mradermacher
Params20.1B
Context8K
Q4_K_M12.8 GB
GR
Granite 4.1 3b Reduced Prompt Injection
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 4.1 3b
Granite · Dzluck
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
IBM_granite 4.1 30b_Abliterated
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
GR
Granite 4.0 1b
Granite · SciTools
Params1.63B
Context128K
Q4_K_M1.0 GB
GR
Granite 4.2 3b Heretic
Granite · mradermacher
Params3.66B
Context128K
Q4_K_M2.2 GB
GR
Debiased Granite 3.2 8b Instruct
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite Cermat Cz 7b
Granite · mradermacher
Params6.67B
Context1024K
Q4_K_M4.0 GB
GR
Granite 4.1 8b Heretic
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
GR
granite speech 5.0 2b Pollard
Granite · PollardWeights
Params1.84B
Context16K
Smallest0.9 GB
GR
granite-7b-instruct
Granite · Mungert
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
Granite 4.1 Queen 8b
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
GR
Granite Guardian 3.3 8b
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite 3.2 8b Instruct
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite-4.1-30B
Granite · jamiefutch
Params28.9B
Context128K
Q4_K_M17.5 GB
GR
Granite 4.1 3B Abliterated
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
granite-3.1-8b-base
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite 8b Qiskit
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Qiskit.granite 3.3 8b Qiskit
Granite · DevQuasar
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite 4.0 H Small
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
GR
granite 3.0 3b a800m base
Granite · QuantFactory
Params3.3B
Context4K
Q4_K_M2.0 GB
GR
Parable Granite 4.1 8B Claude Fable 5
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
GR
Granite 3.0 2b Instruct
Granite · RichardErkhov
Params2.63B
Context4K
Q4_K_M1.6 GB
GR
Granite 4.0 350m Gabliterated
Granite · mradermacher
Params352M
Context32K
Q4_K_M0.2 GB
GR
Granite Speech 4.1 2b Plus
Granite · mradermacher
Params1.63B
Context4K
Q4_K_M1.0 GB
GR
Ibm Granite.Granite Guardian 3.2 5b
Granite · DevQuasar-10
Params5.78B
Context128K
Q4_K_M3.5 GB
GR
Granite Embedding English R2
Granite · mradermacher
Params149M
Context8K
Q4_K_M0.1 GB
GR
Granite 3.3 2b Instruct Critical Thinking
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB