Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 7b Instruct
Granite · ethangoh
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
Akte medium granite
Granite · Fascix
Params3.66B
Context128K
Q4_K_M2.2 GB
GR
Granite Embedding 107m Multilingual
Granite · stefanberger
Params107M
Context512
Q4_K_M0.1 GB
GR
maybe broken granite 4.0 7B A1B Creative v0.3
Granite · WarlordHermes
Params6.94B
Context1024K
Q4_K_M4.2 GB
GR
Granite 4.0 H 1b Heretic
Granite · pszemraj
Params1.46B
Context1024K
Smallest1.2 GB
GR
Granite Embedding English R2
Granite · fisher046
Params149M
Context8K
Smallest0.2 GB
GR
Granite 4.0 H Small
Granite · MichielBuisman
Params32.2B
Context1024K
Smallest12.4 GB
GR
Granite
Granite · vraiti
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
granite 4.0 micro GRPO NuminaMath 20K
Granite · ermiaazarkhalili
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
granite embedding 311m multilingual r2 F16
Granite · rodraco
Params312M
Context32K
Smallest0.6 GB
GR
ADBait 1B
Granite · TitleOS
Params1.46B
Context1024K
Smallest1.6 GB
GR
granite 4.2 8b symbolic cot
Granite · rolandwhere
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
mica granite speech 5
Granite · miguelamendez
Params—
Context—
Smallest0.3 GB
GR
Granite Guardian 3.2 3b A800M
Granite · mrutkows
Params3.3B
Context128K
Q4_K_M2.0 GB
GR
Granite 4.0 1b Summarizer
Granite · sillykiwi
Params1.63B
Context128K
Smallest1.7 GB
GR
granite 20b code instruct Q2 K
Granite · cobrakenji
Params20.1B
Context8K
Smallest7.9 GB
GR
Granite 3.3 2b Instruct
Granite · AmpereComputing
Params2.53B
Context128K
Smallest2.6 GB
GR
Granite 3.3 8b Instruct
Granite · EShawC
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite Embedding 278m Multilingual
Granite · keisuke-miyako
Params277M
Context512
Q4_K_M0.2 GB
GR
Granite 3.2 2b Instruct
Granite · Damien420
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 3.3 2b Summarizer
Granite · sillykiwi
Params2.53B
Context128K
Smallest2.1 GB
GR
Granite 3.1 3b A800M Base
Granite · itlwas
Params3.3B
Context128K
Q4_K_M2.0 GB
GR
tiny random granite i1
Granite · mradermacher
Params2M
Context128K
Q4_K_M0.0 GB
GR
granite 3b code instruct 128k Q4 0
Granite · msyukorai
Params3.48B
Context125K
Smallest2.0 GB
GR
Huihui Granite 4.1 3b Abliterated
Granite · googlecs
Params3.4B
Context128K
Smallest2.0 GB
GR
Granite 3.0 8b Instruct
Granite · anime-sssh
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
Granite 3.3 2b Instruct
Granite · Felladrin
Params2.53B
Context128K
Smallest1.5 GB
GR
Granite 3.0 2b Instruct
Granite · aashish1904
Params2.63B
Context4K
Q4_K_M1.6 GB
GR
Granite 3.1 2b Instruct
Granite · NikolayKozloff
Params2.53B
Context128K
Smallest2.7 GB
GR
granite 3.3 2b instruct lora chinese
Granite · Begonia1005
Params2.53B
Context128K
Smallest5.1 GB