GGUF models by kolosal
41 GGUF models quantized by kolosal on Hugging Face. Sizes run from 494M to 32.8B parameters. The longest trained context is 128K tokens.
About kolosal on Hugging Face
kolosal has published 41 GGUF models that ggufmodels.com tracks, across families such as Qwen, Gemma and Llama. The most downloaded are Qwen2.5 Coder 14B Instruct AWQ, Qwen2.5 Coder 3B Instruct AWQ and Qwen2.5 Coder 1.5B Instruct GGUF.
The quants kolosal publishes most often are Q8_0 (34), Q4_K_M (31), F16 (23) and BF16 (9). Their Q4_K_M files range from 0.4 to 19.9 GB. Parameter counts run from 494M to 32.8B, and the longest trained context window is 128K tokens.
Frequently asked questions
What GGUF models has kolosal published?
41 models are listed here, mainly from the Qwen, Gemma and Llama families. The most downloaded is Qwen2.5 Coder 14B Instruct AWQ.
Which quants does kolosal publish?
The most common are Q8_0 (34 models), Q4_K_M (31 models), F16 (23 models) and BF16 (9 models).