GGUF models by HappyAIUser
40 GGUF models quantized by HappyAIUser on Hugging Face. Sizes run from 1.24B to 14.8B parameters. The longest trained context is 1000K tokens.
About HappyAIUser on Hugging Face
HappyAIUser has published 40 GGUF models that ggufmodels.com tracks, across families such as Atmasiddhigptv, Sussysysysyusd and Atmasiddhigpt. The most downloaded are AtmaSiddhiGPTv26 GGUF, AtmasiddhiGPTv11 and AtmaSiddhiGPTv10.
The quants HappyAIUser publishes most often are Q8_0 (20), Q4_K_M (18), Q5_K_M (16) and F16 (15). Their Q4_K_M files range from 2.0 to 9.0 GB. Parameter counts run from 1.24B to 14.8B, and the longest trained context window is 1000K tokens.
Frequently asked questions
What GGUF models has HappyAIUser published?
40 models are listed here, mainly from the Atmasiddhigptv, Sussysysysyusd and Atmasiddhigpt families. The most downloaded is AtmaSiddhiGPTv26 GGUF.
Which quants does HappyAIUser publish?
The most common are Q8_0 (20 models), Q4_K_M (18 models), Q5_K_M (16 models) and F16 (15 models).