GGUF models by TheDrummer
106 GGUF models quantized by TheDrummer on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.
About TheDrummer on Hugging Face
TheDrummer has published 106 GGUF models that ggufmodels.com tracks, across families such as Mistral, Gemma and Cydonia. The most downloaded are Cydonia 24B v4.3, Rocinante X 12B v1 and Anubis Mini 8B v1.
The quants TheDrummer publishes most often are Q4_K_M (105), Q5_K_M (102), Q6_K (94) and Q3_K_M (93). Their Q4_K_M files range from 1.7 to 85.6 GB. Parameter counts run from 2.61B to 141B, and the longest trained context window is 1000K tokens.
Frequently asked questions
What GGUF models has TheDrummer published?
106 models are listed here, mainly from the Mistral, Gemma and Cydonia families. The most downloaded is Cydonia 24B v4.3.
Which quants does TheDrummer publish?
The most common are Q4_K_M (105 models), Q5_K_M (102 models), Q6_K (94 models) and Q3_K_M (93 models).