Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 3.2 8b Instruct Preview
Granite · DevQuasar-7
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
granite 3 3 8b java code refactoring
Granite · lucas-sousa-pereira
Params8.37B
Context128K
Q4_K_M5.1 GB
CodingReasoningTool use
GR
granite 4.1 3b oracle nl2sql
Granite · Vakamalla-Anitha
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite Speech 3.3 2b
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool useVision
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · mradermacher
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
GR
Ibm Granite.Granite 4.0 Tiny Preview
Granite · DevQuasar
Params6.67B
Context1024K
Q4_K_M4.0 GB
ReasoningTool use
GR
Granite 3.3 8b Qiskit
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Coding
GR
granite-guardian-3.2-3b-a800m
Granite · Mungert
Params3.3B
Context128K
Smallest1.2 GB
Tool use
GR
granite_star_1
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Granite 4.0 7B A1B Creative v0.1
Granite · mradermacher
Params6.67B
Context1024K
Q4_K_M4.0 GB
ReasoningTool use
GR
Granite Guardian 3.2 8b Factuality Detection
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.1 2b FourWheeler
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Huihui Granite 4.1 8b Abliterated
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Granite Speech 3.3 2b
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite 3.3 8b Base
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite 3.0 3b A800M Instruct
Granite · lmstudio-community
Params3.37B
Context4K
Q4_K_M2.1 GB
Tool use
GR
Granite 3.0 1b A400M Base
Granite · mradermacher
Params1.38B
Context4K
Q4_K_M0.9 GB
GGUF
GR
Parable Granite 4.1 3B Claude Fable 5
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
ReasoningTool use
GR
Granite 3.3 2b Finetuned Alpaca Hindi Bengali_Full
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
granite-3.1-2b-base
Granite · Mungert
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 3.0 2b Base
Granite · RichardErkhov
Params2.53B
Context4K
Q4_K_M1.5 GB
GGUF
GR
Granite 7b Instruct
Granite · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GR
Granite 4.2 3b Heretic Abliterated
Granite · mradermacher
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
Granite 4.0 H 1b Base
Granite · mrutkows
Params1.46B
Context1024K
Q4_K_M0.9 GB
GGUF
GR
Granite 3.1 2b Instruct
Granite · Dzluck
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Iq Code Evmind v1 Granite 8b Instruct
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
GR
Granite Vision 4.1 4b
Granite · mrutkows
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool useVision
GR
granite-3.2-8b-instruct-preview
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.1 30B Claude 4.6 Opus Thinking X
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GR
Ibm Granite.Granite 3.0 3b A800M Instruct
Granite · DevQuasar-5
Params3.37B
Context4K
Q4_K_M2.1 GB
Tool use

Keep browsing