GGUF models by duyntnet
305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.
About duyntnet on Hugging Face
duyntnet has published 305 GGUF models that ggufmodels.com tracks, across families such as Qwen, Llama and Mistral. The most downloaded are Phi 3 mini 128k instruct imatrix, Aya Expanse 8b and Granite 8b Code Instruct.
The quants duyntnet publishes most often are Q8_0 (305), Q6_K (305), Q5_K_S (305) and Q5_K_M (305). Their Q4_K_M files range from 0.1 to 21.5 GB. Parameter counts run from 163M to 35B, and the longest trained context window is 1024K tokens.
Frequently asked questions
What GGUF models has duyntnet published?
305 models are listed here, mainly from the Qwen, Llama and Mistral families. The most downloaded is Phi 3 mini 128k instruct imatrix.
Which quants does duyntnet publish?
The most common are Q8_0 (305 models), Q6_K (305 models), Q5_K_S (305 models) and Q5_K_M (305 models).