GGUF models by mrutkows
63 GGUF models quantized by mrutkows on Hugging Face. Sizes run from 30M to 117B parameters. The longest trained context is 1024K tokens.
GR
Granite Embedding 107m Multilingual
Granite · mrutkows
Params107M
Context512
Q4_K_M0.1 GB
GR
Granite Embedding English R2
Granite · mrutkows
Params149M
Context8K
Smallest0.2 GB
GR
Granite Guardian 3.2 5b
Granite · mrutkows
Params5.78B
Context128K
Q4_K_M3.5 GB