Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
thermostat-granite-4
Granite · nightpartycoderteam
Params352M
Context32K
Q4_K_M0.2 GB
CodingTool use
GR
granite speech 4.0 1b
Granite · staghado
Params1.84B
Context4K
Smallest2.0 GB
Vision
GR
Granite 4.0 Micro
Granite · tatsuyaaaaaaa
Params3.4B
Context1024K
Q4_K_M2.1 GB
Tool use
GR
Granite 3.3 2B Instruct Power
Granite · librepowerai
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
granite 4.1 3b
Granite · SandLogicTechnologies
Params3.4B
Context128K
Smallest1.6 GB
ReasoningTool use
GR
Granite 3.0 2b Instruct
Granite · osllmai-community
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
GR
granite 4 350m map commands
Granite · Apolo81
Params352M
Context32K
Q4_K_M0.2 GB
Tool use
GR
Granite 4.1 3B SFT Fable5
Granite · ermiaazarkhalili
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
granite-3b-code-instruct
Granite · newsletter
Params3.48B
Context2K
Smallest2.9 GB
CodingTool use
GR
Granite 3.2 2b Instruct
Granite · ysn-rfd
Params2.53B
Context128K
Smallest1.5 GB
Tool use
GR
granite 3.1 2.5b instruct
Granite · lm-kit
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
qmd query expansion granite 2b
Granite · nichenke
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite 4.0 H Small
Granite · deucebucket
Params32.2B
Context1024K
Smallest15.2 GB
Tool use
GR
granite-8b-code-instruct
Granite · YorkieOH10
Params8.05B
Context4K
Smallest8.6 GB
CodingTool use
GR
granite vision 3.3 2b
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool useVision
GR
granite-3b-code-instruct
Granite · NikolayKozloff
Params3.48B
Context2K
Smallest3.7 GB
CodingTool use
GR
granite vision 3.2 2b
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool useVision
GR
Granite 3.1 3b A800M Base
Granite · mrutkows
Params3.3B
Context128K
Q4_K_M2.0 GB
GGUF
GR
Ibm Granite Granite 3.3 2b Instruct
Granite · tensorblock
Params2.53B
Context128K
Smallest1.0 GB
ReasoningTool use
GR
Granite 3.0 2b Instruct
Granite · davelsphere
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
GR
Granite 3.1 8b Instruct
Granite · ZeroWw
Params8.17B
Context128K
Smallest5.0 GB
Tool use
GR
granite speech 3.3 8b
Granite · cstr
Params8.85B
Context—
Smallest3.1 GB
GGUF
GR
granite moe 1b split
Granite · sinatras
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
GR
Granite3.3 8b Qiskit W2 141728 Dpo G33 Q25 Lora 1 8
Granite · Qiskit
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.1 8B SFT Fable5
Granite · ermiaazarkhalili
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Granite 4.0 H 1b Unsloth
Granite · magiccodingman
Params1.46B
Context1024K
Smallest1.6 GB
Tool use
GR
Granite Speech 4.1 2B
Granite · myflow-ai
Params2.31B
Context—
Smallest1.8 GB
GGUF
GR
Huihui Granite 4.0 H Tiny Abliterated
Granite · fuzzy-mittenz
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
GR
Granite 3.1 2b TwoWheeler
Granite · Prithwiraj731
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
granite-4.2-3b
Granite · kingjones777
Params3.66B
Context128K
Smallest3.9 GB
ReasoningTool use

Keep browsing