Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Ibm Granite Granite 3.2 2b Instruct
Granite · tensorblock
Params2.53B
Context128K
Smallest1.0 GB
Tool use
GR
bling granite 4.2 3b
Granite · llmware
Params3.66B
Context128K
Q4_K_M2.2 GB
GGUF
GR
Granite4.1 8B Heretic
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
Tool use
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_FineWeb.seed2
Granite · DevQuasar-9
Params6.85B
Context8K
Q4_K_M6.0 GB
GGUF
GR
granite 3.1 2b instruct OBLITERATED
Granite · ArRENCEAI
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 3.0 8b Instruct
Granite · duyntnet
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.0 8b Instruct
Granite · lmstudio-community
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.2 3b
Granite · surajkumarmallick
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_GneissWeb.seed2
Granite · DevQuasar-10
Params6.85B
Context8K
Q4_K_M6.0 GB
GGUF
GR
Granite 4.1 8B Function Calling xLAM Unsloth
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
tiny random granite
Granite · mradermacher
Params2M
Context128K
Q4_K_M0.0 GB
Tool use
GR
granite embedding 125m english
Granite · lmstudio-community
Params124M
Context512
Q4_K_M0.1 GB
Embedding
GR
granite 4.1 3b imatrix
Granite · liodon-ai
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Ibm Granite.Granite Guardian 3.0 8b
Granite · DevQuasar
Params8.17B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Granite 3.0 1b A400M Instruct R241010A
Granite · RedHatAI
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use
GR
Granite 4.1 30b
Granite · kingjones777
Params28.9B
Context128K
Smallest16.3 GB
Tool use
GR
granite 3.3 8b instruct abliterated
Granite · alexj03
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Ibm Granite.Granite 3.1 2b Base
Granite · DevQuasar-6
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite Guardian 3.0 2b
Granite · mradermacher
Params2.53B
Context8K
Q4_K_M1.5 GB
GGUF
GR
granite 3.1 8b Reasoning
Granite · ruslanmv
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
granite 4.2 8b imatrix
Granite · liodon-ai
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
Granite-4.0-H-Tiny
Granite · noctrex
Params6.94B
Context1024K
Smallest4.2 GB
Tool use
GR
Granite 4.2 8B ICDU DPO
Granite · Gadsdencode
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
granite-8b-code-instruct
Granite · MoMonir
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
GR
Granite 3b Code Base 2k
Granite · itlwas
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
Dehallucinated Granite 3.2 8b Instruct
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_GneissWeb.seed1
Granite · DevQuasar-9
Params6.85B
Context8K
Q4_K_M6.0 GB
GGUF
GR
Granite Switch 4.1 3b Preview
Granite · barha
Params4.21B
Context128K
Smallest8.4 GB
Tool use
GR
granite 3.0 8b instruct
Granite · neopolita
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite4 Estigia MultilanguageV1
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
Tool use

Keep browsing