Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
TrueGL_Granite
Granite · mradermacher
Params1.33B
Context128K
Q4_K_M0.8 GB
GR
granite finetune
Granite · alwang
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite Embedding 30m English
Granite · mrutkows
Params30M
Context512
Q4_K_M0.0 GB
GR
Granite 4.0 H Small
Granite · AmpereComputing
Params32.2B
Context1024K
Smallest32.7 GB
GR
Granite 3.1 8b Instruct Abliterated
Granite · BernTheCreator
Params8.17B
Context128K
Smallest4.7 GB
GR
Granite 4.0 Tiny Base Preview
Granite · elichen-skymizer
Params6.67B
Context1024K
Smallest5.5 GB
GR
granite-4.2-3b
Granite · kingjones777
Params3.66B
Context128K
Smallest2.1 GB
GR
ibm granite 4.1 8b project aisafety v1.0
Granite · BBwolvBB
Params8.79B
Context128K
Smallest3.8 GB
GR
Granite 3.3 2b Instruct Ethics
Granite · ckuethe
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite Vision 3.3 2B Q M GGUF F16
Granite · ApyHTML19
Params2.53B
Context128K
Smallest1.8 GB
GR
Granite 4.2 3b Nvfp4
Granite · FedericoFB
Params3.66B
Context128K
Smallest2.8 GB
GR
Granite Guardian 4.1 8b
Granite · SandLogicTechnologies
Params8.38B
Context128K
Smallest3.9 GB
GR
granite claude h 350m
Granite · Avtrkrb
Params417M
Context1024K
Q4_K_M0.3 GB
GR
galena 2b math physics
Granite · xJoePec
Params2.53B
Context128K
Smallest5.1 GB
GR
Granite4.1 8B Heretic
Granite · bw72
Params8.38B
Context128K
Smallest6.0 GB
GR
granite 4 micro
Granite · llmware
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Granite 4.0 Tiny Preview
Granite · SaisExperiments
Params6.67B
Context1024K
Smallest7.1 GB
GR
granite-8b-code-instruct-128k
Granite · AmpereComputing
Params8.05B
Context125K
Smallest8.1 GB
GR
Granite 3.3 2b Summarizer
Granite · sillykiwi
Params2.53B
Context128K
Smallest2.7 GB
GR
granite 20b code base Q8 0
Granite · YorkieOH10
Params20.1B
Context8K
Smallest21.4 GB
GR
Granite 3.1 1B A400M RYS 12 15
Granite · john-broadway
Params1.5B
Context128K
Q4_K_M0.9 GB
GR
Granite-4.1-30B
Granite · cPilotGod
Params28.9B
Context128K
Q4_K_M17.5 GB
GR
Granite Guardian3.1 8b
Granite · doaonduty
Params8.17B
Context128K
Smallest8.7 GB
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · sizzlebop
Params3.19B
Context1024K
Smallest3.4 GB
GR
Granite Guardian 3.0 8b
Granite · anime-sssh
Params8.17B
Context8K
Q4_K_M4.9 GB
GR
Granite 4.1 8b Base
Granite · nitinrathi
Params8.38B
Context128K
Q4_K_M5.1 GB
GR
Granite 4.0 350m
Granite · Edge-Quant
Params352M
Context32K
Smallest0.4 GB
GR
Granite 3.3 8b Instruct
Granite · pasan1992
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite 4.0 1b
Granite · Edge-Quant
Params1.63B
Context128K
Q4_K_M1.0 GB
GR
granite 3.2 2b instruct heretic R3 K002
Granite · kalle07
Params2.53B
Context128K
Smallest2.7 GB