GGUF models by TheDrummer

106 GGUF models quantized by TheDrummer on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemmasutra Pro 27B V1F
Gemma · TheDrummer
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
MI
Precog 24B V1B Workspace
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool use
BE
Behemoth 123B v2.1
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
NE
Snowpiercer 15B v3
Nemotron · TheDrummer
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
GE
Gemmasutra 27B v3
Gemma · TheDrummer
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Fallen Gemma3 12B V1D
Gemma · TheDrummer
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
MI
Behemoth ReduX 123B v1.1
Mistral · TheDrummer
Params123B
Context128K
Smallest86.5 GB
Tool use
LL
Valkyrie 49B v2
Llama · TheDrummer
Params49.9B
Context128K
Q4_K_M30.2 GB
ReasoningTool use
BE
Behemoth 123B v1.2
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
RE
Red Squadron 8x22B V1B
Red · TheDrummer
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
CY
Cydonia R1 24B v4
Cydonia · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
TH
Theia 21B v1
Theia · TheDrummer
Params21B
Context1000K
Q4_K_M12.4 GB
GGUF
NE
Big Alice 28B v1
Nemotron · TheDrummer
Params28.6B
Context64K
Q4_K_M17.3 GB
Reasoning
MI
Rivermind 24B V1A Workspace
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
DO
Donnager 70B V1A
Donnager · TheDrummer
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
GE
Gemma 3 R1 12B v1
Gemma · TheDrummer
Params11.8B
Context128K
Q4_K_M7.3 GB
Reasoning
BU
Buddy 2B v1
Buddy · TheDrummer
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 R1 27B v1
Gemma · TheDrummer
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning
TH
Theia 21B V2A
Theia · TheDrummer
Params20.4B
Context1000K
Q4_K_M12.4 GB
GGUF
BE
Behemoth 123B v2
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
GE
Fallen Gemma3 4B V1H
Gemma · TheDrummer
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
AN
Anubis Pro 105B V1A
Anubis · TheDrummer
Params105B
Context128K
Q4_K_M63.0 GB
Tool use
MI
Rivermind Lux 12B V1B Workspace
Mistral · TheDrummer
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
BE
Behemoth 123B v1
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
GE
Gemma 3 R1 4B v1
Gemma · TheDrummer
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
UN
UnslopSmall 22B v1
Unslopsmall · TheDrummer
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
AN
Anubis 70B v1 GGUF BROKEN
Anubis · TheDrummer
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MI
Precog 123B v1
Mistral · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
GE
GEMMA SUTRA
Gemma · TheDrummer
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
MI
Behemoth R1 123B v2
Mistral · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
Reasoning

Keep browsing