GGUF models by TheDrummer
106 GGUF models quantized by TheDrummer on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.
GE
Gemmasutra Pro 27B V1F
Gemma · TheDrummer
Params27.2B
Context8K
Q4_K_M16.6 GB
MI
Precog 24B V1B Workspace
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
BE
Behemoth 123B v2.1
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
NE
Snowpiercer 15B v3
Nemotron · TheDrummer
Params15B
Context64K
Q4_K_M9.1 GB
GE
Gemmasutra 27B v3
Gemma · TheDrummer
Params27B
Context128K
Q4_K_M16.5 GB
GE
Fallen Gemma3 12B V1D
Gemma · TheDrummer
Params11.8B
Context128K
Q4_K_M7.3 GB
MI
Behemoth ReduX 123B v1.1
Mistral · TheDrummer
Params123B
Context128K
Smallest86.5 GB
LL
Valkyrie 49B v2
Llama · TheDrummer
Params49.9B
Context128K
Q4_K_M30.2 GB
BE
Behemoth 123B v1.2
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
RE
Red Squadron 8x22B V1B
Red · TheDrummer
Params141B
Context64K
Q4_K_M85.6 GB
CY
Cydonia R1 24B v4
Cydonia · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
TH
Theia 21B v1
Theia · TheDrummer
Params21B
Context1000K
Q4_K_M12.4 GB
NE
Big Alice 28B v1
Nemotron · TheDrummer
Params28.6B
Context64K
Q4_K_M17.3 GB
MI
Rivermind 24B V1A Workspace
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
DO
Donnager 70B V1A
Donnager · TheDrummer
Params69B
Context32K
Q4_K_M41.4 GB
GE
Gemma 3 R1 12B v1
Gemma · TheDrummer
Params11.8B
Context128K
Q4_K_M7.3 GB
BU
Buddy 2B v1
Buddy · TheDrummer
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 3 R1 27B v1
Gemma · TheDrummer
Params27B
Context128K
Q4_K_M16.5 GB
TH
Theia 21B V2A
Theia · TheDrummer
Params20.4B
Context1000K
Q4_K_M12.4 GB
BE
Behemoth 123B v2
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
GE
Fallen Gemma3 4B V1H
Gemma · TheDrummer
Params3.88B
Context128K
Q4_K_M2.5 GB
AN
Anubis Pro 105B V1A
Anubis · TheDrummer
Params105B
Context128K
Q4_K_M63.0 GB
MI
Rivermind Lux 12B V1B Workspace
Mistral · TheDrummer
Params12.2B
Context128K
Q4_K_M7.5 GB
BE
Behemoth 123B v1
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
GE
Gemma 3 R1 4B v1
Gemma · TheDrummer
Params3.88B
Context128K
Q4_K_M2.5 GB
UN
UnslopSmall 22B v1
Unslopsmall · TheDrummer
Params22.2B
Context128K
Q4_K_M13.3 GB
AN
Anubis 70B v1 GGUF BROKEN
Anubis · TheDrummer
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Precog 123B v1
Mistral · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
GE
GEMMA SUTRA
Gemma · TheDrummer
Params27.2B
Context8K
Q4_K_M16.6 GB
MI
Behemoth R1 123B v2
Mistral · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB