GGUF models by TheDrummer

106 GGUF models quantized by TheDrummer on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Cydonia 24B v4.3
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Rocinante X 12B v1
Mistral · TheDrummer
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
LL
Anubis Mini 8B v1
Llama · TheDrummer
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemmasutra Mini 2B v1
Gemma · TheDrummer
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Rocinante XL 16B v1
Mistral · TheDrummer
Params16.1B
Context128K
Q4_K_M9.7 GB
GGUF
RO
Rocinante 12B v1.1
Rocinante · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Skyfall 31B v4.2
Mistral · TheDrummer
Params31.4B
Context128K
Q4_K_M19.0 GB
Reasoning
GE
Gemmasutra Small 4B v1
Gemma · TheDrummer
Params3.86B
Context8K
Q4_K_M2.5 GB
GGUF
MI
Magidonia 24B v4.3
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
UN
UnslopNemo 12B v3
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
UN
UnslopNemo 12B v4.1
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
Artemis 31B v1.1
Gemma · TheDrummer
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Tiger Gemma 12B v3
Gemma · TheDrummer
Params12.8B
Context128K
Q4_K_M7.9 GB
GGUF
LL
Anubis 70B v1.2
Llama · TheDrummer
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GE
Big Tiger Gemma 27B v3
Gemma · TheDrummer
Params28.4B
Context128K
Q4_K_M17.3 GB
GGUF
GE
Fallen Gemma3 27B V1C
Gemma · TheDrummer
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
CY
Cydonia 24B v4.1
Cydonia · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
CY
Cydonia 22B v1
Cydonia · TheDrummer
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
SK
Skyfall 36B V2A
Skyfall · TheDrummer
Params36.9B
Context32K
Q4_K_M22.4 GB
GGUF
CY
Cydonia 24B v4
Cydonia · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
LL
Valkyrie 49B v2.1
Llama · TheDrummer
Params50B
Context128K
Q4_K_M30.2 GB
GGUF
CY
Cydonia 24B v4.2.0
Cydonia · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
RO
Rocinante 12B V1A
Rocinante · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
Artemis 31B v1
Gemma · TheDrummer
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
MI
Ministrations 8B v1
Ministrations · TheDrummer
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
CY
Cydonia 24B v2
Cydonia · TheDrummer
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GE
Tiger Gemma 9B v3
Gemma · TheDrummer
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
NE
Snowpiercer 15B v4
Nemotron · TheDrummer
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
GE
Tiger Gemma 9B v1
Gemma · TheDrummer
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemmasutra 9B v1
Gemma · TheDrummer
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

About TheDrummer on Hugging Face

TheDrummer has published 106 GGUF models that ggufmodels.com tracks, across families such as Mistral, Gemma and Cydonia. The most downloaded are Cydonia 24B v4.3, Rocinante X 12B v1 and Anubis Mini 8B v1.

The quants TheDrummer publishes most often are Q4_K_M (105), Q5_K_M (102), Q6_K (94) and Q3_K_M (93). Their Q4_K_M files range from 1.7 to 85.6 GB. Parameter counts run from 2.61B to 141B, and the longest trained context window is 1000K tokens.

Frequently asked questions

What GGUF models has TheDrummer published?

106 models are listed here, mainly from the Mistral, Gemma and Cydonia families. The most downloaded is Cydonia 24B v4.3.

Which quants does TheDrummer publish?

The most common are Q4_K_M (105 models), Q5_K_M (102 models), Q6_K (94 models) and Q3_K_M (93 models).

Keep browsing