Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Model Ibm Granite Granite 3.1 8b Instruct Cache
Granite · Alcoft
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
granite-8b-code-instruct-128k
Granite · Mungert
Params8.05B
Context125K
Q4_K_M4.8 GB
CodingTool use
GR
Granite 3.0 1b A400M Instruct
Granite · RichardErkhov
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use
GR
Ibm Granite.Granite 4.0 H Tiny
Granite · DevQuasar
Params6.94B
Context1024K
Q4_K_M4.2 GB
Tool use
GR
Parable Granite 4.1 3B Claude Fable 5 Heretic
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
ReasoningTool use
GR
granite 4.1 30b
Granite · eaddario
Params28.9B
Context128K
Smallest0.0 GB
GGUF
GR
Granite 4.0 H 7b Heretic
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
Tool use
GR
Josiefied Granite 4.0 Micro Abliterated v1
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 4.0 1b Speech
Granite · mradermacher
Params1.84B
Context4K
Q4_K_M1.1 GB
Vision
GR
Granite 4.1 8b Brainstone2 Thinking
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite 4.0 H 1b Base
Granite · mradermacher
Params1.46B
Context1024K
Q4_K_M0.9 GB
GGUF
GR
granite 4.0 h 350m DISTILL gemini 5M CTX
Granite · glogwa68
Params340M
Context5120K
Q4_K_M0.2 GB
ReasoningTool use
GR
Models Huihui Ai Granite 3.2 2b Instruct Abliterated
Granite · MaziyarPanahi
Params2.53B
Context128K
Smallest1.8 GB
Tool use
GR
Granite 4.1 3b Abliterated AND Disinhibited
Granite · Dzluck
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 3.1 1b A400M Instruct
Granite · mradermacher
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
GR
Huihui Granite 4.1 3b Abliterated
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Leesplank Noot Granite 3.3 2b
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite 3.3 8b Instruct
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Orb Human Typeahead 1b v2.2
Granite · chartreuse-verte
Params1.63B
Context128K
Smallest1.0 GB
RoleplayTool use
GR
Granite 4.1 3b Abliterated AND Disinhibited
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite Guardian 3.2 5b
Granite · mradermacher
Params5.78B
Context128K
Q4_K_M3.5 GB
Tool use
GR
Heretic_Granite 3.3 2b Instruct
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite 4.0 Micro
Granite · mrutkows
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 4.1 8b FlintStones V1
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
granite 3.1 2b Reasoning i1
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite 4.2 8B Surgical Abliterated
Granite · medismera
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite 3b Code Instruct 128k
Granite · mradermacher
Params3.48B
Context125K
Q4_K_M2.1 GB
CodingTool use
GR
Granite 4.0 Micro Base
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite 3.1 2b TwoWheeler
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 4.1 3b
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use

Keep browsing