GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
About mradermacher on Hugging Face
mradermacher has published 71,763 GGUF models that ggufmodels.com tracks, across families such as Qwen, Llama and Gemma. The most downloaded are Ornith 1.5 9B Uncensored, Cyber Ornith 1.5 9B OBLITERATED and Qwen3 VL 8B Instruct Abliterated.
The quants mradermacher publishes most often are Q2_K (71469), Q3_K_S (71140), Q3_K_M (71033) and Q3_K_L (70967). Their Q4_K_M files range from 0.0 to 405.8 GB. Parameter counts run from 2M to 673B, and the longest trained context window is 10742K tokens.
Frequently asked questions
What GGUF models has mradermacher published?
71,763 models are listed here, mainly from the Qwen, Llama and Gemma families. The most downloaded is Ornith 1.5 9B Uncensored.
Which quants does mradermacher publish?
The most common are Q2_K (71469 models), Q3_K_S (71140 models), Q3_K_M (71033 models) and Q3_K_L (70967 models).