Granite GGUF models

1547 GGUF models in the Granite family, quantized by 403 uploaders. Sizes run from 2M to 33.7B parameters. The longest trained context is 5120K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GR
Granite 4.0 Micro
Granite · MichielBuisman
Params3.4B
Context128K
Smallest2.1 GB
Tool use
GR
Ibm Granite.Granite 20b Functioncalling
Granite · DevQuasar-8
Params20.1B
Context8K
Q4_K_M12.8 GB
GGUF
GR
SOLARized GraniStral 14B_2102_YeAM HCT_32QKV
Granite · srs6901
Params13.5B
Context256K
Smallest8.2 GB
Tool useVision
GR
Huihui granite 4.1 30b abliterated
Granite · Momix-44
Params28.9B
Context128K
Smallest57.7 GB
Tool use
GR
granite 20b code instruct 8k
Granite · ibm-granite
Params20.1B
Context8K
Q4_K_M12.8 GB
CodingTool use
GR
Granite 4.2 3B Heretic NX PRIME beta 2.4
Granite · 0xzknw
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
granite h350m event commands
Granite · rbrmafort
Params340M
Context1024K
Q4_K_M0.2 GB
Tool use
GR
Leesplank Noot Granite 3.3 2b
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
GR
Granite 4.0 350m Gabliterated
Granite · mradermacher
Params352M
Context32K
Q4_K_M0.2 GB
Tool use
GR
pharos judge free
Granite · pharos-one
Params3.4B
Context128K
Smallest3.6 GB
Tool use
GR
Granite 4.0 H Micro Base
Granite · tatsuyaaaaaaa
Params3.19B
Context1024K
Q4_K_M1.9 GB
GGUF
GR
Granite 4.1 Queen 30b
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
RoleplayTool useVision
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed1
Granite · DevQuasar-9
Params6.85B
Context8K
Q4_K_M6.0 GB
GGUF
GR
granite embedding 278m multilingual
Granite · cstr
Params277M
Context514
Smallest0.3 GB
Embedding
GR
Granite Docling 258M
Granite · prithivMLmods
Params164M
Context8K
Smallest0.2 GB
Vision
GR
Ibm Granite.Granite 3.1 8b Base
Granite · DevQuasar-6
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Ibm Granite Granite 3.0 8b Instruct
Granite · tensorblock
Params8.17B
Context4K
Smallest3.1 GB
Tool use
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_FineWeb.Edu.seed3
Granite · DevQuasar-9
Params6.85B
Context8K
Q4_K_M6.0 GB
GGUF
GR
granite 34b code base 8k
Granite · ibm-granite
Params33.7B
Context8K
Q4_K_M21.4 GB
Coding
GR
Granite 4.1 3B SFT Fable5
Granite · mradermacher
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
granite 3.0 8b base
Granite · neopolita
Params8.17B
Context4K
Q4_K_M4.9 GB
GGUF
GR
Granite 3.0 2b Instruct
Granite · lmstudio-community
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
GR
Granite 4.2 8b Decensored
Granite · qcokvd1
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GR
granite 4.1 3b wh40k tools
Granite · jressler
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Ibm Granite.Granite 4.1 8b
Granite · DevQuasar
Params8.79B
Context128K
Smallest3.4 GB
Tool use
GR
Ibm Granite.Granite 4.0 350m
Granite · DevQuasar
Params352M
Context32K
Q4_K_M0.2 GB
Tool use
GR
SOLARized GraniStral 14B_2202_YeAM HCT_X45QKV
Granite · srs6901
Params13.5B
Context256K
Smallest8.2 GB
Tool useVision
GR
Granite Estigia MultilanguageV3
Granite · mradermacher
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
GR
granite 20b code base 8k
Granite · ibm-granite
Params20.1B
Context8K
Q4_K_M12.8 GB
Coding
GR
granite-3.0-2b-base
Granite · Mungert
Params2.53B
Context4K
Q4_K_M1.5 GB
GGUF

Keep browsing