GGUF models by mrutkows

63 GGUF models quantized by mrutkows on Hugging Face. Sizes run from 30M to 117B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 3.3 8b Instruct
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite Guardian 4.1 8b
Granite · mrutkows
Params8.38B
Context128K
Q4_K_M5.1 GB
Tool use
GR
Granite 3.3 2b Base
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 3.3 2b Instruct
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.0 H 350m
Granite · mrutkows
Params340M
Context1024K
Q4_K_M0.2 GB
Tool use
GR
Granite Guardian 3.1 2b
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 4.0 350m
Granite · mrutkows
Params352M
Context32K
Q4_K_M0.2 GB
Tool use
GR
Granite 3.3 8b Base
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite 3.2 2b Instruct
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
GR
Granite 4.0 1b
Granite · mrutkows
Params1.63B
Context128K
Q4_K_M1.0 GB
Tool use
GR
Granite 4.0 H 1b
Granite · mrutkows
Params1.46B
Context1024K
Q4_K_M0.9 GB
Tool use
GR
Granite Guardian 3.3 8b
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.2 8b Instruct
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.0 Micro
Granite · mrutkows
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 4.1 3b
Granite · mrutkows
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
GR
Granite 3.0 1b A400M Base
Granite · mrutkows
Params1.38B
Context4K
Q4_K_M0.9 GB
GGUF
GR
Granite 4.0 H Micro
Granite · mrutkows
Params3.19B
Context1024K
Q4_K_M1.9 GB
Tool use
GR
Granite 4.0 3b Vision
Granite · mrutkows
Params3.66B
Context128K
Q4_K_M2.2 GB
Tool useVision
GR
Granite 3.0 8b Instruct
Granite · mrutkows
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.1 8b Instruct
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.1 1b A400M Instruct
Granite · mrutkows
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
GR
Granite 4.0 H 1b Base
Granite · mrutkows
Params1.46B
Context1024K
Q4_K_M0.9 GB
GGUF
GR
Granite Vision 4.1 4b
Granite · mrutkows
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool useVision
GR
Granite 3.0 2b Instruct
Granite · mrutkows
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
GR
Granite 3.1 2b Base
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 3.0 1b A400M Instruct
Granite · mrutkows
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use
GR
Granite 4.1 8b
Granite · mrutkows
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
GR
Granite 4.0 1b Speech
Granite · mrutkows
Params1.84B
Context4K
Q4_K_M1.1 GB
Vision
GR
Granite 3.1 8b Base
Granite · mrutkows
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.0 Tiny Preview
Granite · mrutkows
Params6.67B
Context1024K
Q4_K_M4.0 GB
ReasoningTool use

About mrutkows on Hugging Face

mrutkows has published 63 GGUF models that ggufmodels.com tracks, across families such as Granite and gpt-oss. The most downloaded are Granite 3.3 8b Instruct, Granite Guardian 4.1 8b and Granite 3.3 2b Base.

The quants mrutkows publishes most often are Q8_0 (60), Q4_K_M (60), F16 (52) and Q6_K (46). Their Q4_K_M files range from 0.0 to 87.9 GB. Parameter counts run from 30M to 117B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has mrutkows published?

63 models are listed here, mainly from the Granite and gpt-oss families. The most downloaded is Granite 3.3 8b Instruct.

Which quants does mrutkows publish?

The most common are Q8_0 (60 models), Q4_K_M (60 models), F16 (52 models) and Q6_K (46 models).

Keep browsing