GGUF models by DevQuasar-5
95 GGUF models quantized by DevQuasar-5 on Hugging Face. Sizes run from 135M to 479B parameters. The longest trained context is 1000K tokens.
About DevQuasar-5 on Hugging Face
DevQuasar-5 has published 95 GGUF models that ggufmodels.com tracks, across families such as Llama, Granite and Qwen. The most downloaded are huihui ai.granite vision 3.2 2b abliterated, Huihui Ai.Granite 3.2 2b Instruct Abliterated and Llama 3.3 70B Instruct Abliterated.
The quants DevQuasar-5 publishes most often are Q8_0 (94), Q6_K (94), Q5_K_M (94) and Q4_K_M (94). Their Q4_K_M files range from 0.1 to 142.5 GB. Parameter counts run from 135M to 479B, and the longest trained context window is 1000K tokens.
Frequently asked questions
What GGUF models has DevQuasar-5 published?
95 models are listed here, mainly from the Llama, Granite and Qwen families. The most downloaded is huihui ai.granite vision 3.2 2b abliterated.
Which quants does DevQuasar-5 publish?
The most common are Q8_0 (94 models), Q6_K (94 models), Q5_K_M (94 models) and Q4_K_M (94 models).