Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
TrueGL_Granite
Granite · mradermacher
Params1.33B
Context128K
Q4_K_M0.8 GB
GGUF
GR
granite finetune
Granite · alwang
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite Embedding 30m English
Granite · mrutkows
Params30M
Context512
Q4_K_M0.0 GB
Embedding
GR
Granite 4.0 H Small
Granite · AmpereComputing
Params32.2B
Context1024K
Smallest32.7 GB
Tool use
GR
Granite 3.1 8b Instruct Abliterated
Granite · BernTheCreator
Params8.17B
Context128K
Smallest4.7 GB
Tool use
GR
Granite 4.0 Tiny Base Preview
Granite · elichen-skymizer
Params6.67B
Context1024K
Smallest5.5 GB
GGUF
GR
granite-4.2-3b
Granite · kingjones777
Params3.66B
Context128K
Smallest2.1 GB
ReasoningTool use
GR
ibm granite 4.1 8b project aisafety v1.0
Granite · BBwolvBB
Params8.79B
Context128K
Smallest3.8 GB
Tool use
GR
Granite 3.3 2b Instruct Ethics
Granite · ckuethe
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite Vision 3.3 2B Q M GGUF F16
Granite · ApyHTML19
Params2.53B
Context128K
Smallest1.8 GB
Tool useVision
GR
Granite 4.2 3b Nvfp4
Granite · FedericoFB
Params3.66B
Context128K
Smallest2.8 GB
ReasoningTool use
GR
Granite Guardian 4.1 8b
Granite · SandLogicTechnologies
Params8.38B
Context128K
Smallest3.9 GB
ReasoningTool use
GR
granite claude h 350m
Granite · Avtrkrb
Params417M
Context1024K
Q4_K_M0.3 GB
ReasoningTool use
GR
galena 2b math physics
Granite · xJoePec
Params2.53B
Context128K
Smallest5.1 GB
ReasoningTool use
GR
Granite4.1 8B Heretic
Granite · bw72
Params8.38B
Context128K
Smallest6.0 GB
GGUF
GR
granite 4 micro
Granite · llmware
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 4.0 Tiny Preview
Granite · SaisExperiments
Params6.67B
Context1024K
Smallest7.1 GB
ReasoningTool use
GR
granite-8b-code-instruct-128k
Granite · AmpereComputing
Params8.05B
Context125K
Smallest8.1 GB
Coding
GR
Granite 3.3 2b Summarizer
Granite · sillykiwi
Params2.53B
Context128K
Smallest2.7 GB
GGUF
GR
granite 20b code base Q8 0
Granite · YorkieOH10
Params20.1B
Context8K
Smallest21.4 GB
Coding
GR
Granite 3.1 1B A400M RYS 12 15
Granite · john-broadway
Params1.5B
Context128K
Q4_K_M0.9 GB
ReasoningTool use
GR
Granite-4.1-30B
Granite · cPilotGod
Params28.9B
Context128K
Q4_K_M17.5 GB
Tool use
GR
Granite Guardian3.1 8b
Granite · doaonduty
Params8.17B
Context128K
Smallest8.7 GB
Tool use
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · sizzlebop
Params3.19B
Context1024K
Smallest3.4 GB
GGUF
GR
Granite Guardian 3.0 8b
Granite · anime-sssh
Params8.17B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.1 8b Base
Granite · nitinrathi
Params8.38B
Context128K
Q4_K_M5.1 GB
GGUF
GR
Granite 4.0 350m
Granite · Edge-Quant
Params352M
Context32K
Smallest0.4 GB
GGUF
GR
Granite 3.3 8b Instruct
Granite · pasan1992
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Granite 4.0 1b
Granite · Edge-Quant
Params1.63B
Context128K
Q4_K_M1.0 GB
GGUF
GR
granite 3.2 2b instruct heretic R3 K002
Granite · kalle07
Params2.53B
Context128K
Smallest2.7 GB
Tool use

Keep browsing