Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.0 Tiny Base Preview
Granite · elichen-skymizer
Params6.67B
Context1024K
Smallest4.7 GB
GGUF
GR
Granite Guardian 3.2 3b A800M
Granite · stefanberger
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
Granite 4.1 30b
Granite · llmware
Params28.9B
Context128K
Q4_K_M17.8 GB
Tool use
GR
Granite 4.0 H 1b
Granite · NikolayKozloff
Params1.46B
Context1024K
Smallest1.6 GB
GGUF
GR
Granite 4.1 3b
Granite · kingjones777
Params3.4B
Context128K
Smallest2.0 GB
Tool use
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · bunnycore
Params3.19B
Context1024K
Smallest2.3 GB
GGUF
GR
Granite 3 Flux 1
Granite · KushGupster
Params8.37B
Context128K
Q4_K_M5.1 GB
Tool use
GR
Granite 3.1 1b A400M Base
Granite · elichen-skymizer
Params1.33B
Context128K
Q4_K_M0.8 GB
GGUF
GR
granite-8b-code-instruct
Granite · newsletter
Params8.05B
Context4K
Smallest6.6 GB
CodingTool use
GR
Granite 3.0 8b Instruct
Granite · aashish1904
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.3 2b Instruct
Granite · NikolayKozloff
Params2.53B
Context128K
Smallest2.7 GB
ReasoningTool use
GR
Granite Docling 258M
Granite · AXONVERTEX-AI-RESEARCH
Params164M
Context8K
Smallest0.2 GB
CodingVision
GR
Granite 4.0 H 1b Base
Granite · jerkar
Params1.46B
Context1024K
Smallest1.6 GB
GGUF
GR
Granite Speech 4.1 2B
Granite · memoravox
Params2.31B
Context—
Smallest1.8 GB
GGUF
GR
nani
Granite · leeroy-jankins
Params1.63B
Context128K
Q4_K_M1.0 GB
Tool use
GR
granite4 3b ec magento
Granite · gabrielgts
Params3.4B
Context128K
Q4_K_M2.2 GB
Tool use
GR
Granite 4.1 30b
Granite · mrutkows
Params28.9B
Context128K
Q4_K_M17.5 GB
Tool use
GR
IBM Granite 4.1 8b Heretic
Granite · Asystemoffields
Params8.38B
Context128K
Smallest3.6 GB
Tool use
GR
Maitre Granite 3.2 2b Instruct
Granite · ktruestory
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite-4.1-8B
Granite · cPilotGod
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Granite 3.1 3b A800M Instruct
Granite · itlwas
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
Granite 4.0 H 350m
Granite · NikolayKozloff
Params340M
Context1024K
Smallest0.4 GB
GGUF
GR
Granite 3.1 2b Instruct
Granite · skarmani
Params2.53B
Context128K
Smallest1.8 GB
Tool use
GR
dataserve granite4 Text2SQL
Granite · aaaelgendy
Params3.19B
Context1024K
Smallest6.4 GB
Tool use
GR
granite 34b code instruct Q5 K M
Granite · SixOpen
Params33.7B
Context8K
Smallest24.6 GB
CodingTool use
GR
Granite Embedding Reranker English R2
Granite · mrutkows
Params150M
Context8K
Smallest0.2 GB
Embedding
GR
granite-8b-code-instruct
Granite · sroecker
Params8.05B
Context4K
Smallest4.9 GB
Coding
GR
Granite 4.0 H Tiny
Granite · sizzlebop
Params6.94B
Context1024K
Smallest7.4 GB
GGUF
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · sizzlebop
Params3.19B
Context1024K
Smallest1.9 GB
GGUF
GR
granite 8b instruct rpgle
Granite · ticlazau
Params8.05B
Context4K
Q4_K_M4.9 GB
GGUF

Keep browsing