Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.1 30B Claude 4.6 Opus Thinking Xavier
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GR
Ibm Granite.Granite 3.2 2b Instruct
Granite · DevQuasar-9
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 3.0 8b Base
Granite · mradermacher
Params8.17B
Context4K
Q4_K_M4.9 GB
GGUF
GR
Josiefied Granite 4.0 Micro Abliterated v1
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
granite-3.1-1b-a400m-instruct
Granite · Mungert
Params1.33B
Context128K
Smallest0.5 GB
Tool use
GR
Granite Embedding 278m Multilingual
Granite · lmstudio-community
Params277M
Context512
Q4_K_M0.2 GB
Embedding
GR
granite-4.0-350m
Granite · Mungert
Params352M
Context32K
Q4_K_M0.3 GB
Tool use
GR
Granite 3.0 8b Instruct
Granite · mrutkows
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.0 Tiny Base Preview
Granite · mradermacher
Params6.67B
Context1024K
Q4_K_M4.1 GB
GGUF
GR
Granite 3.1 8b Instruct
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.0 1b Speech
Granite · mradermacher
Params1.84B
Context4K
Q4_K_M1.1 GB
GGUF
GR
Granite 4.0 H Tiny Base
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
GR
granite-4.2-30b
Granite · vultr
Params29.3B
Context128K
Q4_K_M19.2 GB
ReasoningTool use
GR
Granite Embedding 107m Multilingual
Granite · keisuke-miyako
Params107M
Context512
Smallest0.1 GB
Embedding
GR
Vetta Granite 2b v3
Granite · mradermacher
Params2.53B
Context4K
Q4_K_M1.5 GB
Tool use
GR
Huihui Ai.Granite 3.1 2b Instruct Abliterated
Granite · DevQuasar-5
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 4.1 8b Abliterated AND Disinhibited
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
Tool use
GR
Granite 4.2 3b
Granite · mradermacher
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
Granite 3.0 3b A800M Instruct
Granite · MCZK
Params3.37B
Context4K
Smallest1.3 GB
Tool use
GR
Ibm Granite.Granite Guardian 3.3 8b
Granite · DevQuasar
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite Guardian 3.2 5b
Granite · ibm-research
Params5.78B
Context128K
Q4_K_M3.5 GB
Tool use
GR
granite speech 4.0 1b loom
Granite · loom-ai-org
Params2.19B
Context—
Smallest8.8 GB
GGUF
GR
granite 7b lab
Granite · instructlab
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GR
Granite Guardian 4.1 8b
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
Tool use
GR
granite 3.0 2b base
Granite · QuantFactory
Params2.53B
Context4K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.1 8B SFT Fable5
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Granite 4.1 8b Brainstone Thinking
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite 3.1 8b Instruct
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.1 30b Abliterated
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
Tool use
GR
Granite 3.0 2b Instruct
Granite · MCZK
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use

Keep browsing