Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.2 8b Nvfp4
Granite · FedericoFB
Params8.79B
Context128K
Smallest6.1 GB
ReasoningTool use
GR
Kestrel 4.1 3b Final
Granite · felixreverett
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
GR
granite 4.0 h 1b math sft lora v1
Granite · pmrccs
Params1.46B
Context1024K
Q4_K_M0.9 GB
Reasoning
GR
granite-4.2-30b
Granite · kingjones777
Params29.3B
Context128K
Smallest30.2 GB
ReasoningTool use
GR
granite 4.2 3b
Granite · abcsnoobai
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
Granite 3.1 1b A400M Base
Granite · mrutkows
Params1.33B
Context128K
Q4_K_M0.8 GB
GGUF
GR
granite 4.1 8b imatrix
Granite · liodon-ai
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Granite 4.0 H 350m Base
Granite · mrutkows
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
GR
Granite Speech 4.1 2B Plus
Granite · tryambientai
Params2.11B
Context—
Smallest2.3 GB
GGUF
GR
TwIL 8B
Granite · aezazfb
Params8.79B
Context128K
Q4_K_M5.3 GB
CodingReasoningTool use
GR
Granite Guardian 3.0 2b
Granite · davelsphere
Params2.53B
Context8K
Q4_K_M1.5 GB
GGUF
GR
tiny random granite moe
Granite · mradermacher
Params3M
Context4K
Q4_K_M0.0 GB
Tool use
GR
Granite 4.1 3B SFT Claude Opus Reasoning Unsloth
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
ReasoningTool use
GR
Granite 4.0 H 350m Unsloth
Granite · magiccodingman
Params340M
Context1024K
Smallest0.3 GB
Tool use
GR
Granite 4.0 H 1b
Granite · the-peoples-solutions
Params1.46B
Context1024K
Q4_K_M0.9 GB
Tool use
GR
Granite 4.0 H Micro
Granite · tatsuyaaaaaaa
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
GR
granite 20b code instruct Q6 K
Granite · newsletter
Params20.1B
Context8K
Smallest16.5 GB
CodingTool use
GR
granite socratic tutor
Granite · Overwatch886
Params3.3B
Context128K
Smallest1.8 GB
GGUF
GR
Granite 3.2 2b Instruct
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 4.2 30b
Granite · gguf
Params29.3B
Context128K
Q4_K_M18.0 GB
ReasoningTool use
GR
Granite 3.1 1b NSFW Amoral Christmas
Granite · Novaciano
Params1.33B
Context128K
Smallest0.8 GB
Tool use
GR
Ibm Granite Granite 3.1 3b A800M Base
Granite · tensorblock
Params3.3B
Context128K
Smallest1.2 GB
GGUF
GR
granite-4.2-30b
Granite · kingjones777
Params29.3B
Context128K
Smallest15.8 GB
ReasoningTool use
GR
Huihui Granite 4.0 H Tiny Abliterated
Granite · noctrex
Params6.94B
Context1024K
Smallest4.2 GB
Tool use
GR
granite-3b-code-instruct
Granite · sroecker
Params3.48B
Context2K
Smallest2.1 GB
Coding
GR
granite-4.2-8b
Granite · kingjones777
Params8.79B
Context128K
Smallest9.2 GB
ReasoningTool use
GR
FFT IBM Granite 4.0 Micro
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
granite-4.2-8b
Granite · kingjones777
Params8.79B
Context128K
Smallest4.9 GB
ReasoningTool use
GR
granite finetune
Granite · junyuu
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
GR
Granite 4.1 8b
Granite · phoenix-gurl
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF

Keep browsing