Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite Speech 4.1 2b
Granite · mrutkows
Params1.84B
Context4K
Q4_K_M1.1 GB
Vision
GR
Granite 3.1 1b A400M Base
Granite · skymizer
Params1.33B
Context128K
Q4_K_M0.8 GB
GGUF
GR
Granite 3.3 8b Instruct
Granite · lm-kit
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Granite Embedding Small English R2
Granite · sanjanasrikanth
Params48M
Context8K
Smallest0.1 GB
Embedding
GR
Granite 3.1 2b Instruct
Granite · itlwas
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite_Hindi
Granite · mradermacher
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
granite 3.0 8b lora intrinsics v0.1 i1
Granite · mradermacher
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.0 H Tiny
Granite · sizzlebop
Params6.94B
Context1024K
Smallest4.0 GB
GGUF
GR
Granite 4.0 H Small
Granite · ggml-org
Params32.2B
Context1024K
Smallest34.3 GB
GGUF
GR
granite-4.2-3b
Granite · kingjones777
Params3.66B
Context128K
Smallest2.2 GB
ReasoningTool use
GR
Granite 4.1 30b
Granite · 1bit-MONSTER
Params28.9B
Context128K
Q4_K_M17.5 GB
Tool use
GR
Granite 3.0 1b A400M Instruct
Granite · farpluto
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use
GR
Granite 3.1 8b Instruct R241212A
Granite · RedHatAI
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite Embedding English R2
Granite · phoenix-gurl
Params149M
Context8K
Smallest0.2 GB
Embedding
GR
granite embedding 311m multilingual r2
Granite · trithemius
Params312M
Context32K
Smallest0.6 GB
Embedding
GR
granite 20b code instruct Q4 0
Granite · NikolayKozloff
Params20.1B
Context8K
Smallest11.5 GB
CodingTool use
GR
granite 20b code base Q3 K L
Granite · NikolayKozloff
Params20.1B
Context8K
Smallest11.6 GB
Coding
GR
Dehallucinated Granite 3.2 8b Instruct
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.3 8b Instruct
Granite · ZeroWw
Params8.17B
Context128K
Smallest5.0 GB
ReasoningTool use
GR
Granite 4.0 1b
Granite · Felladrin
Params1.63B
Context128K
Smallest1.0 GB
Tool use
GR
granite ansible
Granite · nurazwanh
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Newton Insights V1 cannabis extraction science
Granite · KellanF89
Params8.17B
Context128K
Smallest16.3 GB
GGUF
GR
granite 8b cvefixes
Granite · runwayclub
Params8.05B
Context4K
Q4_K_M4.9 GB
GGUF
GR
Granite-4.1-3B
Granite · cPilotGod
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite Embedding 278m Multilingual
Granite · stefanberger
Params277M
Context512
Q4_K_M0.2 GB
Embedding
GR
granite 20b code instruct Q8 0
Granite · YorkieOH10
Params20.1B
Context8K
Smallest21.4 GB
CodingTool use
GR
Granite 4.0 H 350m
Granite · MichielBuisman
Params340M
Context1024K
Smallest0.3 GB
EmbeddingTool use
GR
Granite 4.0 H Micro
Granite · NonMiFrega
Params3.19B
Context1024K
Q4_K_M1.9 GB
GGUF
GR
ToastyPigeon granite 3.3 8b creative
Granite · ArtusDev
Params8.17B
Context128K
Smallest5.6 GB
ReasoningTool use
GR
Granite 4.0 Tiny Base Preview
Granite · skymizer
Params6.67B
Context1024K
Q4_K_M4.1 GB
GGUF

Keep browsing