GGUF models by TheDrummer
106 GGUF models quantized by TheDrummer on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.
HU
Hubble 4B V1C
Hubble · TheDrummer
Params4.51B
Context128K
Q4_K_M2.8 GB
UN
UnslopNemo 12B v2
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
CY
Cydonia R1 24B v4.1
Cydonia · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
GEMMA SUTRA
Gemma · TheDrummer
Params9.24B
Context8K
Q4_K_M5.8 GB
UN
UnslopNemo 12B v4
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Magidonia 24B v4.2.0
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
SK
Skyfall 31B v4
Skyfall · TheDrummer
Params31.4B
Context128K
Q4_K_M19.0 GB
MI
Skyfall 31B v4.1
Mistral · TheDrummer
Params31.4B
Context128K
Q4_K_M19.0 GB
LA
Endurance 100B v1
Lazarus · TheDrummer
Params100B
Context128K
Q4_K_M60.0 GB
MI
Cydonia ReduX 22B v1.1
Mistral · TheDrummer
Params22.2B
Context32K
Q4_K_M13.3 GB
GL
GLM Steam 106B A12B v1
GLM · TheDrummer
Params110B
Context128K
Q4_K_M72.9 GB
CY
Cydonia 22B v1.3
Cydonia · TheDrummer
Params22.2B
Context32K
Q4_K_M13.3 GB
CY
Cydonia 22B v1.2
Cydonia · TheDrummer
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Cydonia 24B v3
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Big Tiger Gemma 27B v1
Gemma · TheDrummer
Params27.2B
Context8K
Q4_K_M16.6 GB
MI
Rivermind 12B V1B Workspace
Mistral · TheDrummer
Params12.2B
Context128K
Q4_K_M7.5 GB
BE
Behemoth 123B v2.2
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
ZE
Tunguska 39B V1A Workspace
Zephyria · TheDrummer
Params39B
Context128K
Q4_K_M23.4 GB
LL
RimDialogue 3B v1
Llama · TheDrummer
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Anubis 70B v1.1
Llama · TheDrummer
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Cydonia 24B v3.1
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Tiger Gemma 9B v2
Gemma · TheDrummer
Params9.24B
Context8K
Q4_K_M5.8 GB
UN
UnslopNemo 12B v1
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Behemoth X 123B v2
Mistral · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
LL
Valkyrie 49B v1
Llama · TheDrummer
Params49.9B
Context128K
Q4_K_M30.2 GB
CY
Cydonia 22B v1.1
Cydonia · TheDrummer
Params22.2B
Context128K
Q4_K_M13.3 GB
IN
Skyfall 39B V1A WS
Interleaved · TheDrummer
Params39B
Context128K
Q4_K_M23.4 GB
NE
Snowpiercer 15B v2
Nemotron · TheDrummer
Params15B
Context64K
Q4_K_M9.1 GB
CY
Cydonia 24B v2.1
Cydonia · TheDrummer
Params23.6B
Context32K
Q4_K_M14.3 GB
SN
Snowpiercer 15B v1
Snowpiercer · TheDrummer
Params15B
Context64K
Q4_K_M9.1 GB