GGUF models by kholiavko
134 GGUF models quantized by kholiavko on Hugging Face. Sizes run from 559M to 14.7B parameters. The longest trained context is 1000K tokens.
About kholiavko on Hugging Face
kholiavko has published 134 GGUF models that ggufmodels.com tracks, across families such as Llama, Reception and Mistral. The most downloaded are reception test 2 guff, test ph4 and test gemma 9b 22 10.
The quants kholiavko publishes most often are Q8_0 (104), Q5_K_M (48), Q4_K_M (47) and F16 (47). Their Q4_K_M files range from 1.6 to 8.9 GB. Parameter counts run from 559M to 14.7B, and the longest trained context window is 1000K tokens.
Frequently asked questions
What GGUF models has kholiavko published?
134 models are listed here, mainly from the Llama, Reception and Mistral families. The most downloaded is reception test 2 guff.
Which quants does kholiavko publish?
The most common are Q8_0 (104 models), Q5_K_M (48 models), Q4_K_M (47 models) and F16 (47 models).