Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite Docling 258M Text
Granite · infil00p
Params164M
Context8K
Q4_K_M0.1 GB
CodingVision
GR
granite 3.1 2b Reasoning
Granite · ruslanmv
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
granite-8b-code-instruct
Granite · YorkieOH10
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
GR
Orb Human Typeahead 350m v1.2
Granite · chartreuse-verte
Params352M
Context32K
Smallest0.4 GB
Roleplay
GR
Debiased Granite 3.2 8b Instruct
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Ibm Granite Granite 3.0 1b A400M Base
Granite · tensorblock
Params1.38B
Context4K
Smallest0.5 GB
GGUF
GR
Granite 3.1 1b A400M Base
Granite · mradermacher
Params1.33B
Context128K
Q4_K_M0.8 GB
GGUF
GR
Granite 4.2 8b
Granite · Fr4nkSt3in
Params8.79B
Context128K
Smallest17.6 GB
ReasoningTool use
GR
Granite 4.0 H 1b Heretic
Granite · mradermacher
Params1.46B
Context1024K
Q4_K_M0.9 GB
Tool use
GR
Granite 4.0 H Micro Base
Granite · mradermacher
Params3.19B
Context1024K
Q4_K_M1.9 GB
GGUF
GR
Granite 8b Code Instruct 128k
Granite · aifoundry-org
Params8.05B
Context125K
Q4_K_M4.9 GB
CodingTool use
GR
Granite 4.0 H 350m Urdu Merged
Granite · mradermacher
Params340M
Context1024K
Q4_K_M0.2 GB
Tool use
GR
Granite Ml Coder
Granite · Tekimax
Params1.33B
Context128K
Q4_K_M0.8 GB
CodingTool use
GR
Granite Docling 258M
Granite · mrutkows
Params164M
Context8K
Q4_K_M0.1 GB
Vision
GR
Granite 4.0 H 32A9B Creative Sft P1
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
Tool use
GR
Granite 4.0 H Tiny IR SFT
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
ReasoningTool use
GR
Granite 4.0 Micro Base
Granite · tatsuyaaaaaaa
Params3.4B
Context1024K
Q4_K_M2.1 GB
GGUF
GR
Granite Embedding 97m Multilingual R2
Granite · trinhrepo
Params97M
Context32K
Smallest0.1 GB
Embedding
GR
Ibm Granite.Granite 4.1 3b
Granite · DevQuasar
Params3.4B
Context128K
Smallest1.4 GB
Tool use
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_GneissWeb.seed3
Granite · DevQuasar-10
Params6.85B
Context8K
Q4_K_M6.0 GB
GGUF
GR
granite-4.0-micro-OpenMed
Granite · openmed-community
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 4.2 3b
Granite · surajkumarmallick
Params3.66B
Context128K
Smallest1.5 GB
ReasoningTool use
GR
Maitre Granite 3.2 2b Instruct
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
granite 4.2 3b imatrix
Granite · liodon-ai
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
Ibm Granite Granite 8b Code Instruct 4k
Granite · tensorblock
Params8.05B
Context4K
Smallest3.1 GB
CodingTool use
GR
Granite 4.1 3B SFT Claude Opus Reasoning Unsloth
Granite · Orionchik
Params3.4B
Context128K
Q4_K_M2.1 GB
ReasoningTool use
GR
Granite 3.0 2b Base
Granite · mradermacher
Params2.53B
Context4K
Q4_K_M1.5 GB
GGUF
GR
Ibm Granite.Granite 4.0 Micro
Granite · DevQuasar
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 3.3 2b Instruct Heretic Safety Defiltered
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
EGL granite 8b final
Granite · mradermacher
Params8.05B
Context125K
Q4_K_M4.9 GB
GGUF

Keep browsing