GGUF models by Qwen
54 GGUF models quantized by Qwen on Hugging Face. Sizes run from 494M to 235B parameters. The longest trained context is 256K tokens.
About Qwen on Hugging Face
Qwen has published 54 GGUF models that ggufmodels.com tracks, across families such as Qwen. The most downloaded are Qwen3Vl 8b Instruct, Qwen3 8B Awq Compatible Instruct and qwen2.5-7b-instruct.
The quants Qwen publishes most often are Q8_0 (52), Q4_K_M (49), Q6_K (37) and Q5_K_M (37). Their Q4_K_M files range from 0.4 to 142.2 GB. Parameter counts run from 494M to 235B, and the longest trained context window is 256K tokens.
Frequently asked questions
What GGUF models has Qwen published?
54 models are listed here, mainly from the Qwen families. The most downloaded is Qwen3Vl 8b Instruct.
Which quants does Qwen publish?
The most common are Q8_0 (52 models), Q4_K_M (49 models), Q6_K (37 models) and Q5_K_M (37 models).