GGUF models by DevQuasar-6
110 GGUF models quantized by DevQuasar-6 on Hugging Face. Sizes run from 362M to 102B parameters. The longest trained context is 1000K tokens.
About DevQuasar-6 on Hugging Face
DevQuasar-6 has published 110 GGUF models that ggufmodels.com tracks, across families such as Llama, Finemath and Qwen. The most downloaded are Qwen.Qwen2.5 VL 3B Instruct, EtherealAurora 12B and Qwen.Qwen2.5 VL 7B Instruct.
The quants DevQuasar-6 publishes most often are Q8_0 (110), Q5_K_M (110), Q4_K_M (110) and Q3_K_M (110). Their Q4_K_M files range from 0.3 to 61.3 GB. Parameter counts run from 362M to 102B, and the longest trained context window is 1000K tokens.
Frequently asked questions
What GGUF models has DevQuasar-6 published?
110 models are listed here, mainly from the Llama, Finemath and Qwen families. The most downloaded is Qwen.Qwen2.5 VL 3B Instruct.
Which quants does DevQuasar-6 publish?
The most common are Q8_0 (110 models), Q5_K_M (110 models), Q4_K_M (110 models) and Q3_K_M (110 models).