Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.0 H Tiny
Granite · AmpereComputing
Params6.94B
Context1024K
Smallest4.7 GB
Tool use
GR
Granite 4.0 H Small
Granite · Govlens
Params32.2B
Context1024K
Q4_K_M19.5 GB
GGUF
GR
granite embedding 97m multilingual r2
Granite · atfai
Params97M
Context32K
Smallest0.2 GB
Embedding
GR
Ibm Granite Granite 3.1 8b Base
Granite · tensorblock
Params8.17B
Context128K
Smallest3.1 GB
GGUF
GR
Ibm Granite Granite Guardian 3.2 3b A800M
Granite · tensorblock
Params3.3B
Context128K
Smallest1.2 GB
Tool use
GR
granite-4.2-8b
Granite · kingjones777
Params8.79B
Context128K
Smallest5.2 GB
ReasoningTool use
GR
Granite 3.1 1b A400M Base
Granite · itlwas
Params1.33B
Context128K
Q4_K_M0.8 GB
GGUF
GR
Granite 3.2 2b Instruct
Granite · NikolayKozloff
Params2.53B
Context128K
Smallest2.7 GB
Tool use
GR
Granite 4.0 350m
Granite · Felladrin
Params352M
Context32K
Smallest0.2 GB
Tool use
GR
Granite 4.0 H 1b
Granite · Felladrin
Params1.46B
Context1024K
Smallest0.9 GB
Tool use
GR
Granite 4.0 Tiny Base Preview
Granite · elichen-skymizer
Params6.67B
Context1024K
Q4_K_M4.1 GB
GGUF
GR
Granite 4.1 30b
Granite · harishkumar12k
Params28.9B
Context128K
Q4_K_M17.5 GB
GGUF
GR
Granite 3.2 2b Instruct
Granite · TiananZ
Params2.53B
Context128K
Smallest2.7 GB
Tool use
GR
Granite 3.2 8b Instruct
Granite · fedora-copr
Params8.17B
Context128K
Smallest4.9 GB
Tool use
GR
Granite 3.1 2b Qa Function
Granite · mradermacher
Params2.63B
Context128K
Q4_K_M1.6 GB
GGUF
GR
granite embedding multilingual r2
Granite · keisuke-miyako
Params312M
Context32K
Smallest0.1 GB
Embedding
GR
Granite 3.0 1b A400M Instruct
Granite · itlwas
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use
GR
Granite 3.3 8b Instruct
Granite · SandLogicTechnologies
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
granite 20b code instruct Q5 K M
Granite · Wusul
Params20.1B
Context8K
Smallest14.7 GB
CodingTool use
GR
Granite Docling 258M
Granite · philipp-zettl
Params164M
Context8K
Smallest0.2 GB
CodingVision
GR
Granite 3.3 2b Reviser
Granite · sillykiwi
Params2.53B
Context128K
Smallest2.1 GB
Vision
GR
granite 4.0 1b speech
Granite · voicetide
Params2.31B
Context—
Smallest1.8 GB
GGUF
GR
Granite 3.1 2b Instruct
Granite · msyukorai
Params2.53B
Context128K
Smallest1.4 GB
Tool use
GR
granite 4.1 agentic 500k
Granite · shazzadulimun
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
granite cermat cz 7b
Granite · wowbager
Params6.67B
Context1024K
Smallest13.4 GB
ReasoningTool use
GR
Granite 3.1 8b Instruct Abliterated
Granite · ZeroWw
Params8.17B
Context128K
Smallest5.0 GB
Tool use
GR
granite 4.0 1b cn
Granite · lucaelin
Params1.63B
Context128K
Smallest1.7 GB
Tool use
GR
granite-4.2-30b
Granite · kingjones777
Params29.3B
Context128K
Smallest16.7 GB
ReasoningTool use
GR
Granite 4.0 Micro
Granite · NonMiFrega
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
granite-4.2-3b
Granite · kingjones777
Params3.66B
Context128K
Smallest3.8 GB
ReasoningTool use

Keep browsing