Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
granite embedding small english r2 gguf q8 0
Granite · keisuke-miyako
Params48M
Context8K
Smallest0.1 GB
Embedding
GR
granite guardian hap 125m Q4 0
Granite · u3man
Params125M
Context512
Smallest0.1 GB
GGUF
GR
Granite 4.0 350m
Granite · jon7009
Params352M
Context32K
Q4_K_M0.2 GB
Tool use
GR
granitelib rag r1.0
Granite · cguna
Params14M
Context—
Smallest0.0 GB
GGUF
GR
Granite 3.1 2b Instruct
Granite · Felladrin
Params2.53B
Context128K
Smallest1.5 GB
Tool use
GR
granite 4.0 7B A1B Creative v0.3
Granite · WarlordHermes
Params6.94B
Context1024K
Q4_K_M4.2 GB
Tool use
GR
granite-7b-base
Granite · cobrakenji
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GR
granite3 instruct 8b
Granite · trufae
Params8.17B
Context4K
Smallest2.5 GB
Tool use
GR
Granite Embedding 278m Multilingual
Granite · hongkeon
Params277M
Context512
Smallest0.3 GB
Embedding
GR
Granite Guardian 3.0 2b
Granite · mrutkows
Params2.53B
Context8K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.0 H Tiny Base
Granite · mrutkows
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
GR
granite 4.0 1b speech
Granite · memoravox
Params2.31B
Context—
Smallest1.8 GB
GGUF
GR
Granite 3.0 2b Instruct
Granite · aashish1904
Params2.63B
Context4K
Smallest1.0 GB
Tool use
GR
Granite 4.1 3B Medical Reasoning
Granite · Kerassy
Params3.4B
Context128K
Q4_K_M2.1 GB
ReasoningTool use
GR
granite embedding 125m english
Granite · mrutkows
Params124M
Context512
Q4_K_M0.1 GB
Embedding
GR
Granite Estigia MultilanguageV2
Granite · franciscobdl
Params3.3B
Context128K
Smallest2.4 GB
Tool use
GR
granite 3b code base
Granite · lukas-bibl
Params3.48B
Context2K
Smallest7.0 GB
Coding
GR
granite 34b code base Q2 K
Granite · cobrakenji
Params33.7B
Context8K
Smallest13.1 GB
Coding
GR
Granite 3.2 2b Instruct
Granite · ZeroWw
Params2.53B
Context128K
Smallest1.6 GB
Tool use
GR
Granite 3.0 8b Instruct
Granite · tsalles
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
hawky ai ibm granite 3.0 8b
Granite · Sri-Vigneshwar-DJ
Params2.63B
Context4K
Smallest5.3 GB
Tool use
GR
Granite 3.2 8b Instruct
Granite · cobrakenji
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite Guardian 3.2 5b Lora Harm Categories
Granite · ksmu
Params17M
Context—
Smallest0.1 GB
GGUF
GR
Granite Embedding Small English R2
Granite · mrutkows
Params48M
Context8K
Smallest0.1 GB
Embedding
GR
Granite 3.1 8b Instruct
Granite · Lucy-in-the-Sky
Params8.17B
Context128K
Smallest8.7 GB
Tool use
GR
ibm granite granite 4.1 8b.q4 k m
Granite · Imaginare
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Granite Speech 4.1 2b
Granite · Srijan-Chakraborty
Params1.84B
Context4K
Q4_K_M1.1 GB
GGUF
GR
Granite 4.0 1b
Granite · NikolayKozloff
Params1.63B
Context128K
Smallest1.7 GB
GGUF
GR
Ibm Granite_Granite 4.1 8b
Granite · n810x
Params8.79B
Context128K
Smallest17.6 GB
GGUF
GR
Granite 3.1 1b A400M Base
Granite · elichen-skymizer
Params1.33B
Context128K
Smallest1.0 GB
GGUF

Keep browsing