GGUF models by richardyoung
35 GGUF models quantized by richardyoung on Hugging Face. Sizes run from 596M to 480B parameters. The longest trained context is 256K tokens.
About richardyoung on Hugging Face
richardyoung has published 35 GGUF models that ggufmodels.com tracks, across families such as Qwen, OLMo and Lightonocr. The most downloaded are Qwen3 14B Abliterated Conservative, Qwen2.5 7B Instruct Abliterated and Qwen3 8b Abliterated.
The quants richardyoung publishes most often are Q4_K_M (30), Q8_0 (28), Q5_K_M (23) and Q6_K (21). Their Q4_K_M files range from 0.4 to 19.9 GB. Parameter counts run from 596M to 480B, and the longest trained context window is 256K tokens.
Frequently asked questions
What GGUF models has richardyoung published?
35 models are listed here, mainly from the Qwen, OLMo and Lightonocr families. The most downloaded is Qwen3 14B Abliterated Conservative.
Which quants does richardyoung publish?
The most common are Q4_K_M (30 models), Q8_0 (28 models), Q5_K_M (23 models) and Q6_K (21 models).