Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 3.0 1B A400M Instruct BE
Granite · taronaeo
Params1.33B
Context4K
Q4_K_M0.8 GB
GGUF
GR
Granite 4.1 3B BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite 3.1 1b A400M Instruct
Granite · lmstudio-community
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
GR
granite-8b-code-instruct-4k
Granite · Mungert
Params8.05B
Context4K
Q4_K_M4.8 GB
CodingTool use
GR
Granite 4.0 350m
Granite · mrutkows
Params352M
Context32K
Q4_K_M0.2 GB
Tool use
GR
Granite 4.2 3b
Granite · gguf
Params3.66B
Context128K
Q4_K_M2.3 GB
ReasoningTool use
GR
Granite 4.1 8b FlintStones V1
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Granite 4.0 H Small Heretic_Lo
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
Tool use
GR
Granite 3.3 8b Base
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
granite-3.3-8b-instruct
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Granite 4.0 H Small Base
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
GGUF
GR
ibm-granite/granite-3.3-2b-instruct
Granite · DevQuasar-12
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite 3b Code Base 128k
Granite · mradermacher
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
GR
Granite 4.1 8b
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Ibm Granite_Granite 4.2 30b
Granite · lmstudio-community
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GR
Granite Speech 5.0 2b
Granite · mradermacher
Params1.84B
Context16K
Q4_K_M1.1 GB
Vision
GR
Granite 4.1 8b Tangerine
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Ibm Granite.Granite 4.0 1b
Granite · DevQuasar
Params1.63B
Context128K
Q4_K_M1.0 GB
Tool use
GR
ibm-granite/granite-3.3-2b-base
Granite · DevQuasar-12
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.2 3b
Granite · nile-academy
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
Granite 4.0 H Micro BE
Granite · taronaeo
Params3.19B
Context1024K
Q4_K_M1.9 GB
GGUF
GR
Huihui Granite 4.0 Micro Abliterated
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Ibm Granite.Granite 3b Code Base 2k
Granite · DevQuasar-8
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
granite 4.0 h 350m DISTILL gemini think
Granite · glogwa68
Params340M
Context1024K
Q4_K_M0.2 GB
ReasoningTool use
GR
granite 3.1 8b instruct
Granite · QuantFactory
Params8.37B
Context128K
Q4_K_M5.1 GB
Tool use
GR
Granite Embedding 97m Multilingual R2
Granite · xnohat
Params97M
Context32K
Q4_K_M0.1 GB
Embedding
GR
Granite 3.1 2b FourWheeler
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite Embedding 311m Multilingual R2
Granite · mykor
Params312M
Context8K
Q4_K_M0.3 GB
Embedding
GR
Granite 4.0 H Tiny Base
Granite · ibm-granite
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
GR
Granite 3.1 2b Instruct
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use

Keep browsing