Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
granite-4.0-micro-base
Granite · Mungert
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
Granite 3b Code Base 128k
Granite · mradermacher
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
GR
granite-8b-code-instruct
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
GR
Granite 8b Code Base 128k
Granite · mradermacher
Params8.05B
Context125K
Q4_K_M4.9 GB
Coding
GR
Granite 3.3 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.1 8b Abliterated
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
GGUF
GR
Granite 3.3 8b Instruct
Granite · bartowski
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite 3.3 8b Instruct
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
granite-3b-code-instruct
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
GR
Ibm Granite_Granite 4.1 8b
Granite · lmstudio-community
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
GR
Granite 4.0 Micro
Granite · bartowski
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
granite 34b code instruct i1
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
CodingTool use
GR
Granite 3.2 8b Instruct
Granite · lmstudio-community
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Parable Granite 4.1 3B Claude Fable 5 heretic
Granite · saidutta69
Params3.4B
Context128K
Q4_K_M2.1 GB
ReasoningTool use
GR
Granite Switch 4.1 8b
Granite · ibm-granite
Params8.97B
Context128K
Q4_K_M6.4 GB
Tool use
GR
Granite 8b Code Instruct 4k
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
GR
Granite 20b Code Instruct 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use
GR
Granite 3b Code Base 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
granite 3b code base 128k
Granite · QuantFactory
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
GR
granite docling 258M
Granite · ggml-org
Params164M
Context8K
Smallest0.2 GB
Vision
GR
Granite-4.1-30B
Granite · unsloth
Params28.9B
Context128K
Q4_K_M17.5 GB
GGUF
GR
granite 20b code instruct
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use
GR
Granite-4.0-H-350M
Granite · unsloth
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
GR
Granite 4.1 8b
Granite · bartowski
Params8.79B
Context128K
Q4_K_M5.5 GB
GGUF
GR
Granite 20b Code Base 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
Coding
GR
Granite 20b Code Base 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
Coding
GR
Granite 20b Code Base
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
Coding
GR
granite 34b code instruct
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
CodingTool use
GR
Granite 34b Code Base 8k
Granite · RichardErkhov
Params33.7B
Context8K
Q4_K_M21.4 GB
Coding
GR
granite 4.2 3b
Granite · NANI-Nithin
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use

Keep browsing