GGUF models by TheDrummer

106 GGUF models quantized by TheDrummer on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
HU
Hubble 4B V1C
Hubble · TheDrummer
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
UN
UnslopNemo 12B v2
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CY
Cydonia R1 24B v4.1
Cydonia · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
GE
GEMMA SUTRA
Gemma · TheDrummer
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
UN
UnslopNemo 12B v4
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Magidonia 24B v4.2.0
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool use
SK
Skyfall 31B v4
Skyfall · TheDrummer
Params31.4B
Context128K
Q4_K_M19.0 GB
GGUF
MI
Skyfall 31B v4.1
Mistral · TheDrummer
Params31.4B
Context128K
Q4_K_M19.0 GB
ReasoningTool use
LA
Endurance 100B v1
Lazarus · TheDrummer
Params100B
Context128K
Q4_K_M60.0 GB
Tool use
MI
Cydonia ReduX 22B v1.1
Mistral · TheDrummer
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
GL
GLM Steam 106B A12B v1
GLM · TheDrummer
Params110B
Context128K
Q4_K_M72.9 GB
ReasoningTool use
CY
Cydonia 22B v1.3
Cydonia · TheDrummer
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
CY
Cydonia 22B v1.2
Cydonia · TheDrummer
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
Cydonia 24B v3
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
GE
Big Tiger Gemma 27B v1
Gemma · TheDrummer
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
MI
Rivermind 12B V1B Workspace
Mistral · TheDrummer
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
BE
Behemoth 123B v2.2
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
ZE
Tunguska 39B V1A Workspace
Zephyria · TheDrummer
Params39B
Context128K
Q4_K_M23.4 GB
Tool use
LL
RimDialogue 3B v1
Llama · TheDrummer
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Anubis 70B v1.1
Llama · TheDrummer
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MI
Cydonia 24B v3.1
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
GE
Tiger Gemma 9B v2
Gemma · TheDrummer
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
UN
UnslopNemo 12B v1
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Behemoth X 123B v2
Mistral · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
LL
Valkyrie 49B v1
Llama · TheDrummer
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
CY
Cydonia 22B v1.1
Cydonia · TheDrummer
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
IN
Skyfall 39B V1A WS
Interleaved · TheDrummer
Params39B
Context128K
Q4_K_M23.4 GB
Tool use
NE
Snowpiercer 15B v2
Nemotron · TheDrummer
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
CY
Cydonia 24B v2.1
Cydonia · TheDrummer
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
SN
Snowpiercer 15B v1
Snowpiercer · TheDrummer
Params15B
Context64K
Q4_K_M9.1 GB
GGUF

Keep browsing