Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Orb Human Typeahead 1b v2.1
Granite · chartreuse-verte
Params1.63B
Context128K
Smallest1.0 GB
RoleplayTool use
GR
Granite Embedding Reranker English R2
Granite · trithemius
Params150M
Context8K
Smallest0.3 GB
Embedding
GR
Ibm Granite Granite 3.0 3b A800M Base
Granite · tensorblock
Params3.37B
Context4K
Smallest1.3 GB
GGUF
GR
Granite 4.1 30b
Granite · deucebucket
Params28.9B
Context128K
Smallest12.6 GB
Tool use
GR
Granite 4.0 H 1b
Granite · MichielBuisman
Params1.46B
Context1024K
Smallest0.9 GB
Tool use
GR
IBM4.1 Unnoticed.Thinker.Uncensored 3B
Granite · callmefattyy
Params3B
Context—
Q4_K_M2.1 GB
Reasoning
GR
Granite 3.0 3b A800M Instruct
Granite · osllmai
Params3.37B
Context4K
Q4_K_M2.1 GB
Tool use
GR
Granite 4.0 H 32A9B Creative Sft P1
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
Tool use
GR
Ibm Granite Granite Guardian 3.0 2b
Granite · tensorblock
Params2.53B
Context8K
Smallest1.0 GB
GGUF
GR
granite speech 3.2 8b
Granite · cstr
Params8.68B
Context—
Smallest3.0 GB
GGUF
GR
Huihui Granite 4.0 H Micro Abliterated
Granite · noctrex
Params3.19B
Context1024K
Smallest3.4 GB
Tool use
GR
Granite 4.0 H Micro
Granite · lm-kit
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
GR
Granite 3.2 2b Instruct
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
granite 3.1 8b instruct
Granite · lm-kit
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
SOLARized GraniStral 14B 2102 YeAM HCT 32QKV
Granite · srs6901
Params13.5B
Context256K
Smallest14.4 GB
Tool useVision
GR
Granite 3.0 2b Base
Granite · mrutkows
Params2.53B
Context4K
Q4_K_M1.5 GB
GGUF
GR
Granite 3.0 8b Base
Granite · mradermacher
Params8.17B
Context4K
Q4_K_M4.9 GB
GGUF
GR
IBM granite 4.0 micro
Granite · ss-lab
Params3.4B
Context128K
Smallest2.0 GB
Tool use
GR
ibm-granite/granite-timeseries-ttm-r2
Granite · amaye15
Params—
Context512
Smallest0.0 GB
GGUF
GR
Granite 8b Code Instruct 4k
Granite · pacohub
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
GR
geoai outdoor model
Granite · F4K3S4T1SH
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Ibm Granite Granite 3.0 3b A800M Instruct
Granite · tensorblock
Params3.37B
Context4K
Smallest1.3 GB
Tool use
GR
Ibm Granite_Granite 3.3 8b Instruct
Granite · smarttasks
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Granite 3.2 8b Instruct Preview
Granite · cgus
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
granite 4.1 30b DASHQ Q2
Granite · jkim96
Params28.9B
Context128K
Smallest8.0 GB
Tool use
GR
Granite 4.0 H Micro
Granite · mradermacher
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
GR
granite 3.2 it
Granite · cortexso
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Ibm Granite Granite 7b Instruct
Granite · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
GR
SOLARized-GraniStral-14B_1902_YeAM-HCT
Granite · srs6901
Params13.5B
Context256K
Smallest14.4 GB
Tool useVision
GR
Granite 20b Code Instruct 8k
Granite · andrewtxiz
Params20.1B
Context8K
Q4_K_M12.8 GB
CodingTool use

Keep browsing