Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 3.1 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context128K
Smallest8.7 GB
Tool use
GR
Granite 3.2 8b Instruct Preview
Granite · AaronFeng753
Params8.17B
Context128K
Smallest8.7 GB
Tool use
GR
swarm
Granite · dongzi01
Params8.19B
Context128K
Smallest2.4 GB
Tool use
GR
Granite 3.0 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context4K
Smallest8.7 GB
Tool use
GR
Granite 3.2 8b Instruct Preview
Granite · Cran-May
Params8.17B
Context128K
Smallest4.7 GB
Tool use
GR
Granite Embedding 278m Multilingual
Granite · mrutkows
Params277M
Context512
Q4_K_M0.2 GB
Embedding
GR
granite-3b-code-base
Granite · NikolayKozloff
Params3.48B
Context2K
Smallest3.7 GB
Coding
GR
Granite 4.0 Tiny Base Preview
Granite · elichen-skymizer
Params6.67B
Context1024K
Smallest7.1 GB
GGUF
GR
granite-3b-code-base
Granite · YorkieOH10
Params3.48B
Context2K
Smallest3.7 GB
Coding
GR
Granite 3.3 8b Instruct
Granite · NikolayKozloff
Params8.17B
Context128K
Smallest8.7 GB
ReasoningTool use
GR
Granite 3.0 8b Instruct
Granite · aashish1904
Params8.17B
Context4K
Smallest3.1 GB
Tool use
GR
Granite 3.2 8b Instruct Preview
Granite · msyukorai
Params8.17B
Context128K
Smallest4.7 GB
Tool use
GR
Granite 3.1 8b Instruct
Granite · Joseph717171
Params8.17B
Context128K
Smallest5.6 GB
Tool use
GR
medical granite 350m
Granite · sandepaAI
Params352M
Context1024K
Smallest0.3 GB
Tool use
GR
Granite 3.1 8b Instruct
Granite · ObeJ
Params8.17B
Context128K
Smallest8.7 GB
Tool use
GR
Granite Speech 4.1 2b
Granite · viniciusianni
Params1.84B
Context4K
Smallest2.0 GB
GGUF
GR
Granite 4.0 H Tiny
Granite · mrutkows
Params6.94B
Context1024K
Q4_K_M4.2 GB
Tool use
GR
granite 4.0 micro 3b cn
Granite · lucaelin
Params3.4B
Context128K
Smallest3.6 GB
Tool use
GR
Granite 4.1 8b
Granite · mikelpr
Params8.79B
Context128K
Smallest4.3 GB
GGUF
GR
Granite 3.3 2b Instruct Story Refiner
Granite · echos-keeper
Params2.53B
Context128K
Smallest2.7 GB
GGUF
GR
Granite 4.1 3b
Granite · NikolayKozloff
Params3.4B
Context128K
Smallest3.6 GB
GGUF
GR
granite-3b-code-base
Granite · cobrakenji
Params3.48B
Context2K
Smallest2.5 GB
Coding
GR
granite 20b code base Q3 K M
Granite · cobrakenji
Params20.1B
Context8K
Smallest10.6 GB
Coding
GR
Granite 3.0 1b A400M Instruct
Granite · marroyo777
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use
GR
Granite 3.1 8b Instruct
Granite · SandLogicTechnologies
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite Docling 258M
Granite · padeoe
Params164M
Context8K
Smallest0.2 GB
Vision
GR
Granite 3.0 8b Instruct
Granite · win10
Params8.17B
Context4K
Smallest8.7 GB
Tool use
GR
Granite 20b Functioncalling
Granite · DaveLeongSG
Params20.1B
Context8K
Q4_K_M12.8 GB
GGUF
GR
Granite 4.1 3b Heretic
Granite · vlx1
Params3.4B
Context128K
Smallest6.8 GB
Tool use
GR
Granite 3.0 3b A800M Instruct
Granite · davelsphere
Params3.37B
Context4K
Q4_K_M2.1 GB
Tool use

Keep browsing