Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Orb Human Typeahead 1b v2.1
Granite · chartreuse-verte
Params1.63B
Context128K
Smallest1.0 GB
GR
Granite Embedding Reranker English R2
Granite · trithemius
Params150M
Context8K
Smallest0.3 GB
GR
Ibm Granite Granite 3.0 3b A800M Base
Granite · tensorblock
Params3.37B
Context4K
Smallest1.3 GB
GR
Granite 4.1 30b
Granite · deucebucket
Params28.9B
Context128K
Smallest12.6 GB
GR
Granite 4.0 H 1b
Granite · MichielBuisman
Params1.46B
Context1024K
Smallest0.9 GB
GR
IBM4.1 Unnoticed.Thinker.Uncensored 3B
Granite · callmefattyy
Params3B
Context—
Q4_K_M2.1 GB
GR
Granite 3.0 3b A800M Instruct
Granite · osllmai
Params3.37B
Context4K
Q4_K_M2.1 GB
GR
Granite 4.0 H 32A9B Creative Sft P1
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
GR
Ibm Granite Granite Guardian 3.0 2b
Granite · tensorblock
Params2.53B
Context8K
Smallest1.0 GB
GR
granite speech 3.2 8b
Granite · cstr
Params8.68B
Context—
Smallest3.0 GB
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · noctrex
Params3.19B
Context1024K
Smallest3.4 GB
GR
Granite 4.0 H Micro
Granite · lm-kit
Params3.19B
Context1024K
Q4_K_M1.9 GB
GR
Granite 3.2 2b Instruct
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
granite 3.1 8b instruct
Granite · lm-kit
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
SOLARized GraniStral 14B 2102 YeAM HCT 32QKV
Granite · srs6901
Params13.5B
Context256K
Smallest14.4 GB
GR
Granite 3.0 2b Base
Granite · mrutkows
Params2.53B
Context4K
Q4_K_M1.5 GB
GR
Granite 3.0 8b Base
Granite · mradermacher
Params8.17B
Context4K
Q4_K_M4.9 GB
GR
IBM granite 4.0 micro
Granite · ss-lab
Params3.4B
Context128K
Smallest2.0 GB
GR
ibm-granite/granite-timeseries-ttm-r2
Granite · amaye15
Params—
Context512
Smallest0.0 GB
GR
Granite 8b Code Instruct 4k
Granite · pacohub
Params8.05B
Context4K
Q4_K_M4.9 GB
GR
geoai outdoor model
Granite · F4K3S4T1SH
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Ibm Granite Granite 3.0 3b A800M Instruct
Granite · tensorblock
Params3.37B
Context4K
Smallest1.3 GB
GR
Ibm Granite_Granite 3.3 8b Instruct
Granite · smarttasks
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite 3.2 8b Instruct Preview
Granite · cgus
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
granite 4.1 30b DASHQ Q2
Granite · jkim96
Params28.9B
Context128K
Smallest8.0 GB
GR
Granite 4.0 H Micro
Granite · mradermacher
Params3.19B
Context1024K
Q4_K_M1.9 GB
GR
granite 3.2 it
Granite · cortexso
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Ibm Granite Granite 7b Instruct
Granite · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GR
SOLARized-GraniStral-14B_1902_YeAM-HCT
Granite · srs6901
Params13.5B
Context256K
Smallest14.4 GB
GR
Granite 20b Code Instruct 8k
Granite · andrewtxiz
Params20.1B
Context8K
Q4_K_M12.8 GB