GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
About MaziyarPanahi on Hugging Face
MaziyarPanahi has published 1,376 GGUF models that ggufmodels.com tracks, across families such as Mistral, Llama and Qwen. The most downloaded are Models Qwen Qwen3 0.6B, Models Qwen Qwen3 4B and Models Qwen Qwen3 14B.
The quants MaziyarPanahi publishes most often are Q5_K_M (1367), Q6_K (1357), Q5_K_S (1315) and Q8_0 (1181). Their Q4_K_M files range from 0.0 to 142.5 GB. Parameter counts run from 10M to 671B, and the longest trained context window is 1024K tokens.
Frequently asked questions
What GGUF models has MaziyarPanahi published?
1,376 models are listed here, mainly from the Mistral, Llama and Qwen families. The most downloaded is Models Qwen Qwen3 0.6B.
Which quants does MaziyarPanahi publish?
The most common are Q5_K_M (1367 models), Q6_K (1357 models), Q5_K_S (1315 models) and Q8_0 (1181 models).