Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
granite-4.0-micro-base
Granite · Mungert
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 3b Code Base 128k
Granite · mradermacher
Params3.48B
Context125K
Q4_K_M2.1 GB
GR
granite-8b-code-instruct
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite 8b Code Base 128k
Granite · mradermacher
Params8.05B
Context125K
Q4_K_M4.9 GB
GR
Granite 3.3 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 4.1 8b Abliterated
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
GR
Granite 3.3 8b Instruct
Granite · bartowski
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite 3.3 8b Instruct
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
granite-3b-code-instruct
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
Ibm Granite_Granite 4.1 8b
Granite · lmstudio-community
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 4.0 Micro
Granite · bartowski
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
granite 34b code instruct i1
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
GR
Granite 3.2 8b Instruct
Granite · lmstudio-community
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Parable Granite 4.1 3B Claude Fable 5 heretic
Granite · saidutta69
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite Switch 4.1 8b
Granite · ibm-granite
Params8.97B
Context128K
Q4_K_M6.4 GB
GR
Granite 8b Code Instruct 4k
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
Granite 20b Code Instruct 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
GR
Granite 3b Code Base 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
granite 3b code base 128k
Granite · QuantFactory
Params3.48B
Context125K
Q4_K_M2.1 GB
GR
granite docling 258M
Granite · ggml-org
Params164M
Context8K
Smallest0.2 GB
GR
Granite-4.1-30B
Granite · unsloth
Params28.9B
Context128K
Q4_K_M17.5 GB
GR
granite 20b code instruct
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
GR
Granite-4.0-H-350M
Granite · unsloth
Params340M
Context1024K
Q4_K_M0.2 GB
GR
Granite 4.1 8b
Granite · bartowski
Params8.79B
Context128K
Q4_K_M5.5 GB
GR
Granite 20b Code Base 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
GR
Granite 20b Code Base 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
GR
Granite 20b Code Base
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
GR
granite 34b code instruct
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
GR
Granite 34b Code Base 8k
Granite · RichardErkhov
Params33.7B
Context8K
Q4_K_M21.4 GB
GR
granite 4.2 3b
Granite · NANI-Nithin
Params3.66B
Context128K
Q4_K_M2.2 GB