Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
thermostat-granite-4
Granite · nightpartycoderteam
Params352M
Context32K
Q4_K_M0.2 GB
GR
granite speech 4.0 1b
Granite · staghado
Params1.84B
Context4K
Smallest2.0 GB
GR
Granite 4.0 Micro
Granite · tatsuyaaaaaaa
Params3.4B
Context1024K
Q4_K_M2.1 GB
GR
Granite 3.3 2B Instruct Power
Granite · librepowerai
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
granite 4.1 3b
Granite · SandLogicTechnologies
Params3.4B
Context128K
Smallest1.6 GB
GR
Granite 3.0 2b Instruct
Granite · osllmai-community
Params2.63B
Context4K
Q4_K_M1.6 GB
GR
granite 4 350m map commands
Granite · Apolo81
Params352M
Context32K
Q4_K_M0.2 GB
GR
Granite 4.1 3B SFT Fable5
Granite · ermiaazarkhalili
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
granite-3b-code-instruct
Granite · newsletter
Params3.48B
Context2K
Smallest2.9 GB
GR
Granite 3.2 2b Instruct
Granite · ysn-rfd
Params2.53B
Context128K
Smallest1.5 GB
GR
granite 3.1 2.5b instruct
Granite · lm-kit
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
qmd query expansion granite 2b
Granite · nichenke
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 4.0 H Small
Granite · deucebucket
Params32.2B
Context1024K
Smallest15.2 GB
GR
granite-8b-code-instruct
Granite · YorkieOH10
Params8.05B
Context4K
Smallest8.6 GB
GR
granite vision 3.3 2b
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
granite-3b-code-instruct
Granite · NikolayKozloff
Params3.48B
Context2K
Smallest3.7 GB
GR
granite vision 3.2 2b
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 3.1 3b A800M Base
Granite · mrutkows
Params3.3B
Context128K
Q4_K_M2.0 GB
GR
Ibm Granite Granite 3.3 2b Instruct
Granite · tensorblock
Params2.53B
Context128K
Smallest1.0 GB
GR
Granite 3.0 2b Instruct
Granite · davelsphere
Params2.63B
Context4K
Q4_K_M1.6 GB
GR
Granite 3.1 8b Instruct
Granite · ZeroWw
Params8.17B
Context128K
Smallest5.0 GB
GR
granite speech 3.3 8b
Granite · cstr
Params8.85B
Context—
Smallest3.1 GB
GR
granite moe 1b split
Granite · sinatras
Params1.33B
Context128K
Q4_K_M0.8 GB
GR
Granite3.3 8b Qiskit W2 141728 Dpo G33 Q25 Lora 1 8
Granite · Qiskit
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite 4.1 8B SFT Fable5
Granite · ermiaazarkhalili
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 4.0 H 1b Unsloth
Granite · magiccodingman
Params1.46B
Context1024K
Smallest1.6 GB
GR
Granite Speech 4.1 2B
Granite · myflow-ai
Params2.31B
Context—
Smallest1.8 GB
GR
Huihui Granite 4.0 H Tiny Abliterated
Granite · fuzzy-mittenz
Params6.94B
Context1024K
Q4_K_M4.2 GB
GR
Granite 3.1 2b TwoWheeler
Granite · Prithwiraj731
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
granite-4.2-3b
Granite · kingjones777
Params3.66B
Context128K
Smallest3.9 GB