GGUF models by mrutkows

63 GGUF models quantized by mrutkows on Hugging Face. Sizes run from 30M to 117B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite Embedding 107m Multilingual
Granite · mrutkows
Params107M
Context512
Q4_K_M0.1 GB
Embedding
GR
Granite Embedding English R2
Granite · mrutkows
Params149M
Context8K
Smallest0.2 GB
Embedding
GR
Granite Guardian 3.2 5b
Granite · mrutkows
Params5.78B
Context128K
Q4_K_M3.5 GB
Tool use

Keep browsing