GGUF models by ysn-rfd
149 GGUF models quantized by ysn-rfd on Hugging Face. Sizes run from 7M to 40.2B parameters. The longest trained context is 501K tokens.
About ysn-rfd on Hugging Face
ysn-rfd has published 149 GGUF models that ggufmodels.com tracks, across families such as Qwen, Llama and Gpt. The most downloaded are Chatbench Distilgpt2, Test_FIBO_IDEN_FFN and Arch Function Chat 3B.
The quants ysn-rfd publishes most often are Q8_0 (101), Q4_0 (58), Q5_0 (53) and Q4_K_M (24). Their Q4_K_M files range from 0.1 to 7.6 GB. Parameter counts run from 7M to 40.2B, and the longest trained context window is 501K tokens.
Frequently asked questions
What GGUF models has ysn-rfd published?
149 models are listed here, mainly from the Qwen, Llama and Gpt families. The most downloaded is Chatbench Distilgpt2.
Which quants does ysn-rfd publish?
The most common are Q8_0 (101 models), Q4_0 (58 models), Q5_0 (53 models) and Q4_K_M (24 models).