Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
OpenIntelligenceNet-granite-4.1-3b-uncensored
Granite · OpenIntelligenceNet
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 4.1 8b Apostate
Granite · Spaceballs
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Ibm Granite3.3 8b Ethical v0.2
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
granite embedding 97m multilingual r2
Granite · Lorelum
Params97M
Context32K
Smallest0.1 GB
Embedding
GR
Granite 4.0 Tiny Base Preview
Granite · mrutkows
Params6.67B
Context1024K
Q4_K_M4.1 GB
GGUF
GR
Ibm Granite Granite 34b Code Base 8k
Granite · tensorblock
Params33.7B
Context8K
Smallest13.1 GB
Coding
GR
granite 3.0 1b a400m instruct
Granite · osllmai-community
Params3.37B
Context4K
Q4_K_M2.1 GB
Tool use
GR
Granite Guardian 4.0 3b Toxicity Ja
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
granite guardian 3.0 2b
Granite · QuantFactory
Params2.53B
Context8K
Q4_K_M1.5 GB
GGUF
GR
Granite Guardian 3.1 8b
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
granite 4.1 8b DASHQ Q2
Granite · jkim96
Params8.79B
Context128K
Smallest2.8 GB
Tool use
GR
ibm granite docling 258M
Granite · danchev
Params164M
Context8K
Smallest0.2 GB
Vision
GR
Qiskit.granite 8b Qiskit
Granite · DevQuasar
Params8.05B
Context4K
Q4_K_M4.9 GB
GGUF
GR
joa job extractor 400m
Granite · JobOpportunitiesAPI
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
GR
Granite 4.0 1b Speech
Granite · ibm-granite
Params1.84B
Context4K
Q4_K_M1.1 GB
Vision
GR
granite-3b-code-instruct
Granite · celek
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
GR
lumynax infused granite33 8b
Granite · AbteeXAILab
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Ibm Granite Granite 3b Code Instruct 2k
Granite · tensorblock
Params3.48B
Context2K
Smallest1.3 GB
CodingTool use
GR
Ibm Granite.Granite 4.2 3b
Granite · DevQuasar
Params3.66B
Context128K
Smallest1.5 GB
ReasoningTool use
GR
Granite 4.0 350m Base
Granite · mrutkows
Params352M
Context32K
Q4_K_M0.2 GB
GGUF
GR
granite tidy
Granite · ddydyss
Params—
Context—
Smallest0.1 GB
GGUF
GR
Granite 4.0 H Tiny Adaptive Reasoning
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
ReasoningTool use
GR
Granite 3.1 3b A800M Instruct
Granite · mrutkows
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
Ibm Granite Granite 34b Code Instruct 8k
Granite · tensorblock
Params33.7B
Context8K
Smallest13.1 GB
CodingTool use
GR
Half Granite Marvin
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
Tool use
GR
Granite 3b Code Instruct 2k
Granite · itlwas
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
GR
Boollm Granite 4.2 3B
Granite · Boollm
Params3.66B
Context128K
Smallest2.6 GB
ReasoningTool use
GR
Ibm Granite.Granite 3.1 1b A400M Instruct
Granite · DevQuasar-6
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2
Granite · DevQuasar-9
Params6.85B
Context8K
Q4_K_M6.0 GB
GGUF
GR
TrueGL_Granite
Granite · mradermacher
Params1.33B
Context128K
Q4_K_M0.8 GB
GGUF

Keep browsing