Granite GGUF models
1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.
GR
Granite 3.1 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context128K
Smallest8.7 GB
GR
Granite 3.2 8b Instruct Preview
Granite · AaronFeng753
Params8.17B
Context128K
Smallest8.7 GB
GR
swarm
Granite · dongzi01
Params8.19B
Context128K
Smallest2.4 GB
GR
Granite 3.0 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context4K
Smallest8.7 GB
GR
Granite 3.2 8b Instruct Preview
Granite · Cran-May
Params8.17B
Context128K
Smallest4.7 GB
GR
Granite Embedding 278m Multilingual
Granite · mrutkows
Params277M
Context512
Q4_K_M0.2 GB
GR
granite-3b-code-base
Granite · NikolayKozloff
Params3.48B
Context2K
Smallest3.7 GB
GR
Granite 4.0 Tiny Base Preview
Granite · elichen-skymizer
Params6.67B
Context1024K
Smallest7.1 GB
GR
granite-3b-code-base
Granite · YorkieOH10
Params3.48B
Context2K
Smallest3.7 GB
GR
Granite 3.3 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context128K
Smallest8.7 GB
GR
Granite 3.0 8b Instruct
Granite · aashish1904
Params8.17B
Context4K
Smallest3.1 GB
GR
Granite 3.2 8b Instruct Preview
Granite · msyukorai
Params8.17B
Context128K
Smallest4.7 GB
GR
Granite 3.1 8b Instruct
Granite · Joseph717171
Params8.17B
Context128K
Smallest5.6 GB
GR
medical granite 350m
Granite · sandepaAI
Params352M
Context1024K
Smallest0.3 GB
GR
Granite 3.1 8b Instruct
Granite · ObeJ
Params8.17B
Context128K
Smallest8.7 GB
GR
Granite Speech 4.1 2b
Granite · viniciusianni
Params1.84B
Context4K
Smallest2.0 GB
GR
Granite 4.0 H Tiny
Granite · mrutkows
Params6.94B
Context1024K
Q4_K_M4.2 GB
GR
granite 4.0 micro 3b cn
Granite · lucaelin
Params3.4B
Context128K
Smallest3.6 GB
GR
Granite 4.1 8b
Granite · mikelpr
Params8.79B
Context128K
Smallest4.3 GB
GR
Granite 3.3 2b Instruct Story Refiner
Granite · echos-keeper
Params2.53B
Context128K
Smallest2.7 GB
GR
Granite 4.1 3b
Granite · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GR
granite-3b-code-base
Granite · cobrakenji
Params3.48B
Context2K
Smallest2.5 GB
GR
granite 20b code base Q3 K M
Granite · cobrakenji
Params20.1B
Context8K
Smallest10.6 GB
GR
Granite 3.0 1b A400M Instruct
Granite · marroyo777
Params1.33B
Context4K
Q4_K_M0.8 GB
GR
Granite 3.1 8b Instruct
Granite · SandLogicTechnologies
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
Granite Docling 258M
Granite · padeoe
Params164M
Context8K
Smallest0.2 GB
GR
Granite 3.0 8b Instruct
Granite · win10
Params8.17B
Context4K
Smallest8.7 GB
GR
Granite 20b Functioncalling
Granite · DaveLeongSG
Params20.1B
Context8K
Q4_K_M12.8 GB
GR
Granite 4.1 3b Heretic
Granite · vlx1
Params3.4B
Context128K
Smallest6.8 GB
GR
Granite 3.0 3b A800M Instruct
Granite · davelsphere
Params3.37B
Context4K
Q4_K_M2.1 GB