Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
granite embedding small english r2 gguf q8 0
Granite · keisuke-miyako
Params48M
Context8K
Smallest0.1 GB
GR
granite guardian hap 125m Q4 0
Granite · u3man
Params125M
Context512
Smallest0.1 GB
GR
Granite 4.0 350m
Granite · jon7009
Params352M
Context32K
Q4_K_M0.2 GB
GR
granitelib rag r1.0
Granite · cguna
Params14M
Context—
Smallest0.0 GB
GR
Granite 3.1 2b Instruct
Granite · Felladrin
Params2.53B
Context128K
Smallest1.5 GB
GR
granite 4.0 7B A1B Creative v0.3
Granite · WarlordHermes
Params6.94B
Context1024K
Q4_K_M4.2 GB
GR
granite-7b-base
Granite · cobrakenji
Params6.74B
Context2K
Q4_K_M4.1 GB
GR
granite3 instruct 8b
Granite · trufae
Params8.17B
Context4K
Smallest2.5 GB
GR
Granite Embedding 278m Multilingual
Granite · hongkeon
Params277M
Context512
Smallest0.3 GB
GR
Granite Guardian 3.0 2b
Granite · mrutkows
Params2.53B
Context8K
Q4_K_M1.5 GB
GR
Granite 4.0 H Tiny Base
Granite · mrutkows
Params6.94B
Context1024K
Q4_K_M4.2 GB
GR
granite 4.0 1b speech
Granite · memoravox
Params2.31B
Context—
Smallest1.8 GB
GR
Granite 3.0 2b Instruct
Granite · aashish1904
Params2.63B
Context4K
Smallest1.0 GB
GR
Granite 4.1 3B Medical Reasoning
Granite · Kerassy
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
granite embedding 125m english
Granite · mrutkows
Params124M
Context512
Q4_K_M0.1 GB
GR
Granite Estigia MultilanguageV2
Granite · franciscobdl
Params3.3B
Context128K
Smallest2.4 GB
GR
granite 3b code base
Granite · lukas-bibl
Params3.48B
Context2K
Smallest7.0 GB
GR
granite 34b code base Q2 K
Granite · cobrakenji
Params33.7B
Context8K
Smallest13.1 GB
GR
Granite 3.2 2b Instruct
Granite · ZeroWw
Params2.53B
Context128K
Smallest1.6 GB
GR
Granite 3.0 8b Instruct
Granite · tsalles
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
hawky ai ibm granite 3.0 8b
Granite · Sri-Vigneshwar-DJ
Params2.63B
Context4K
Smallest5.3 GB
GR
Granite 3.2 8b Instruct
Granite · cobrakenji
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite Guardian 3.2 5b Lora Harm Categories
Granite · ksmu
Params17M
Context—
Smallest0.1 GB
GR
Granite Embedding Small English R2
Granite · mrutkows
Params48M
Context8K
Smallest0.1 GB
GR
Granite 3.1 8b Instruct
Granite · Lucy-in-the-Sky
Params8.17B
Context128K
Smallest8.7 GB
GR
ibm granite granite 4.1 8b.q4 k m
Granite · Imaginare
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite Speech 4.1 2b
Granite · Srijan-Chakraborty
Params1.84B
Context4K
Q4_K_M1.1 GB
GR
Granite 4.0 1b
Granite · NikolayKozloff
Params1.63B
Context128K
Smallest1.7 GB
GR
Ibm Granite_Granite 4.1 8b
Granite · n810x
Params8.79B
Context128K
Smallest17.6 GB
GR
Granite 3.1 1b A400M Base
Granite · elichen-skymizer
Params1.33B
Context128K
Smallest1.0 GB