Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 7b Instruct
Granite · ethangoh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GR
Akte medium granite
Granite · Fascix
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
Granite Embedding 107m Multilingual
Granite · stefanberger
Params107M
Context512
Q4_K_M0.1 GB
Embedding
GR
maybe broken granite 4.0 7B A1B Creative v0.3
Granite · WarlordHermes
Params6.94B
Context1024K
Q4_K_M4.2 GB
Tool use
GR
Granite 4.0 H 1b Heretic
Granite · pszemraj
Params1.46B
Context1024K
Smallest1.2 GB
GGUF
GR
Granite Embedding English R2
Granite · fisher046
Params149M
Context8K
Smallest0.2 GB
Embedding
GR
Granite 4.0 H Small
Granite · MichielBuisman
Params32.2B
Context1024K
Smallest12.4 GB
Tool use
GR
Granite
Granite · vraiti
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
granite 4.0 micro GRPO NuminaMath 20K
Granite · ermiaazarkhalili
Params3.4B
Context128K
Q4_K_M2.1 GB
ReasoningTool use
GR
granite embedding 311m multilingual r2 F16
Granite · rodraco
Params312M
Context32K
Smallest0.6 GB
Embedding
GR
ADBait 1B
Granite · TitleOS
Params1.46B
Context1024K
Smallest1.6 GB
GGUF
GR
granite 4.2 8b symbolic cot
Granite · rolandwhere
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
mica granite speech 5
Granite · miguelamendez
Params—
Context—
Smallest0.3 GB
GGUF
GR
Granite Guardian 3.2 3b A800M
Granite · mrutkows
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
Granite 4.0 1b Summarizer
Granite · sillykiwi
Params1.63B
Context128K
Smallest1.7 GB
GGUF
GR
granite 20b code instruct Q2 K
Granite · cobrakenji
Params20.1B
Context8K
Smallest7.9 GB
CodingTool use
GR
Granite 3.3 2b Instruct
Granite · AmpereComputing
Params2.53B
Context128K
Smallest2.6 GB
ReasoningTool use
GR
Granite 3.3 8b Instruct
Granite · EShawC
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Granite Embedding 278m Multilingual
Granite · keisuke-miyako
Params277M
Context512
Q4_K_M0.2 GB
Embedding
GR
Granite 3.2 2b Instruct
Granite · Damien420
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 3.3 2b Summarizer
Granite · sillykiwi
Params2.53B
Context128K
Smallest2.1 GB
GGUF
GR
Granite 3.1 3b A800M Base
Granite · itlwas
Params3.3B
Context128K
Q4_K_M2.0 GB
GGUF
GR
tiny random granite i1
Granite · mradermacher
Params2M
Context128K
Q4_K_M0.0 GB
Tool use
GR
granite 3b code instruct 128k Q4 0
Granite · msyukorai
Params3.48B
Context125K
Smallest2.0 GB
CodingTool use
GR
Huihui Granite 4.1 3b Abliterated
Granite · googlecs
Params3.4B
Context128K
Smallest2.0 GB
GGUF
GR
Granite 3.0 8b Instruct
Granite · anime-sssh
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.3 2b Instruct
Granite · Felladrin
Params2.53B
Context128K
Smallest1.5 GB
ReasoningTool use
GR
Granite 3.0 2b Instruct
Granite · aashish1904
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
GR
Granite 3.1 2b Instruct
Granite · NikolayKozloff
Params2.53B
Context128K
Smallest2.7 GB
Tool use
GR
granite 3.3 2b instruct lora chinese
Granite · Begonia1005
Params2.53B
Context128K
Smallest5.1 GB
ReasoningTool use

Keep browsing