Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 4.0 Tiny Base Preview
Granite · elichen-skymizer
Params6.67B
Context1024K
Smallest4.7 GB
GR
Granite Guardian 3.2 3b A800M
Granite · stefanberger
Params3.3B
Context128K
Q4_K_M2.0 GB
GR
Granite 4.1 30b
Granite · llmware
Params28.9B
Context128K
Q4_K_M17.8 GB
GR
Granite 4.0 H 1b
Granite · NikolayKozloff
Params1.46B
Context1024K
Smallest1.6 GB
GR
Granite 4.1 3b
Granite · kingjones777
Params3.4B
Context128K
Smallest2.0 GB
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · bunnycore
Params3.19B
Context1024K
Smallest2.3 GB
GR
Granite 3 Flux 1
Granite · KushGupster
Params8.37B
Context128K
Q4_K_M5.1 GB
GR
Granite 3.1 1b A400M Base
Granite · elichen-skymizer
Params1.33B
Context128K
Q4_K_M0.8 GB
GR
granite-8b-code-instruct
Granite · newsletter
Params8.05B
Context4K
Smallest6.6 GB
GR
Granite 3.0 8b Instruct
Granite · aashish1904
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
Granite 3.3 2b Instruct
Granite · NikolayKozloff
Params2.53B
Context128K
Smallest2.7 GB
GR
Granite Docling 258M
Granite · AXONVERTEX-AI-RESEARCH
Params164M
Context8K
Smallest0.2 GB
GR
Granite 4.0 H 1b Base
Granite · jerkar
Params1.46B
Context1024K
Smallest1.6 GB
GR
Granite Speech 4.1 2B
Granite · memoravox
Params2.31B
Context—
Smallest1.8 GB
GR
nani
Granite · leeroy-jankins
Params1.63B
Context128K
Q4_K_M1.0 GB
GR
granite4 3b ec magento
Granite · gabrielgts
Params3.4B
Context128K
Q4_K_M2.2 GB
GR
Granite 4.1 30b
Granite · mrutkows
Params28.9B
Context128K
Q4_K_M17.5 GB
GR
IBM Granite 4.1 8b Heretic
Granite · Asystemoffields
Params8.38B
Context128K
Smallest3.6 GB
GR
Maitre Granite 3.2 2b Instruct
Granite · ktruestory
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite-4.1-8B
Granite · cPilotGod
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 3.1 3b A800M Instruct
Granite · itlwas
Params3.3B
Context128K
Q4_K_M2.0 GB
GR
Granite 4.0 H 350m
Granite · NikolayKozloff
Params340M
Context1024K
Smallest0.4 GB
GR
Granite 3.1 2b Instruct
Granite · skarmani
Params2.53B
Context128K
Smallest1.8 GB
GR
dataserve granite4 Text2SQL
Granite · aaaelgendy
Params3.19B
Context1024K
Smallest6.4 GB
GR
granite 34b code instruct Q5 K M
Granite · SixOpen
Params33.7B
Context8K
Smallest24.6 GB
GR
Granite Embedding Reranker English R2
Granite · mrutkows
Params150M
Context8K
Smallest0.2 GB
GR
granite-8b-code-instruct
Granite · sroecker
Params8.05B
Context4K
Smallest4.9 GB
GR
Granite 4.0 H Tiny
Granite · sizzlebop
Params6.94B
Context1024K
Smallest7.4 GB
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · sizzlebop
Params3.19B
Context1024K
Smallest1.9 GB
GR
granite 8b instruct rpgle
Granite · ticlazau
Params8.05B
Context4K
Q4_K_M4.9 GB