Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
OpenIntelligenceNet-granite-4.1-3b-uncensored
Granite · OpenIntelligenceNet
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 4.1 8b Apostate
Granite · Spaceballs
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Ibm Granite3.3 8b Ethical v0.2
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
granite embedding 97m multilingual r2
Granite · Lorelum
Params97M
Context32K
Smallest0.1 GB
GR
Granite 4.0 Tiny Base Preview
Granite · mrutkows
Params6.67B
Context1024K
Q4_K_M4.1 GB
GR
Ibm Granite Granite 34b Code Base 8k
Granite · tensorblock
Params33.7B
Context8K
Smallest13.1 GB
GR
granite 3.0 1b a400m instruct
Granite · osllmai-community
Params3.37B
Context4K
Q4_K_M2.1 GB
GR
Granite Guardian 4.0 3b Toxicity Ja
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
granite guardian 3.0 2b
Granite · QuantFactory
Params2.53B
Context8K
Q4_K_M1.5 GB
GR
Granite Guardian 3.1 8b
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
granite 4.1 8b DASHQ Q2
Granite · jkim96
Params8.79B
Context128K
Smallest2.8 GB
GR
ibm granite docling 258M
Granite · danchev
Params164M
Context8K
Smallest0.2 GB
GR
Qiskit.granite 8b Qiskit
Granite · DevQuasar
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
joa job extractor 400m
Granite · JobOpportunitiesAPI
Params1.33B
Context128K
Q4_K_M0.8 GB
GR
Granite 4.0 1b Speech
Granite · ibm-granite
Params1.84B
Context4K
Q4_K_M1.1 GB
GR
granite-3b-code-instruct
Granite · celek
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
lumynax infused granite33 8b
Granite · AbteeXAILab
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Ibm Granite Granite 3b Code Instruct 2k
Granite · tensorblock
Params3.48B
Context2K
Smallest1.3 GB
GR
Ibm Granite.Granite 4.2 3b
Granite · DevQuasar
Params3.66B
Context128K
Smallest1.5 GB
GR
Granite 4.0 350m Base
Granite · mrutkows
Params352M
Context32K
Q4_K_M0.2 GB
GR
granite tidy
Granite · ddydyss
Params—
Context—
Smallest0.1 GB
GR
Granite 4.0 H Tiny Adaptive Reasoning
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
GR
Granite 3.1 3b A800M Instruct
Granite · mrutkows
Params3.3B
Context128K
Q4_K_M2.0 GB
GR
Ibm Granite Granite 34b Code Instruct 8k
Granite · tensorblock
Params33.7B
Context8K
Smallest13.1 GB
GR
Half Granite Marvin
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
GR
Granite 3b Code Instruct 2k
Granite · itlwas
Params3.48B
Context2K
Q4_K_M2.1 GB
GR
Boollm Granite 4.2 3B
Granite · Boollm
Params3.66B
Context128K
Smallest2.6 GB
GR
Ibm Granite.Granite 3.1 1b A400M Instruct
Granite · DevQuasar-6
Params1.33B
Context128K
Q4_K_M0.8 GB
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed2
Granite · DevQuasar-9
Params6.85B
Context8K
Q4_K_M6.0 GB
GR
TrueGL_Granite
Granite · mradermacher
Params1.33B
Context128K
Q4_K_M0.8 GB