GGUF models by TheDrummer

106 GGUF models quantized by TheDrummer on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
Star Command R 32B v1
Command R · TheDrummer
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
IN
MS Interleaved Upscale 39B
Interleaved · TheDrummer
Params39B
Context128K
Q4_K_M23.4 GB
Tool use
EN
Endurance 100B v1.1
Endurance · TheDrummer
Params100B
Context128K
Q4_K_M60.0 GB
Tool use
CO
Agatha 111B v1
Command R · TheDrummer
Params111B
Context256K
Q4_K_M67.1 GB
Tool use
LL
Fallen Llama 3.3 R1 70B v1
Llama · TheDrummer
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
FA
Fallen Command A 111B V1B
Fallen · TheDrummer
Params111B
Context256K
Q4_K_M67.1 GB
GGUF
MI
Mixtral 4x3B V1A Workspace
Mistral · TheDrummer
Params10.4B
Context32K
Q4_K_M6.3 GB
Tool useVision
BE
Behemoth 123B v1.1
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
NA
Nautilus 70B v0.1
Nautilus · TheDrummer
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MI
Cydonia ReduX 22B v1
Mistral · TheDrummer
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
Behemoth ReduX 123B v1
Mistral · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
FA
Fallen Command A 111B v1.1
Fallen · TheDrummer
Params111B
Context256K
Q4_K_M67.1 GB
GGUF
BE
Behemoth X 123B v2.1
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
LL
Fallen Llama 3.3 70B v1
Llama · TheDrummer
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
AG
Agatha 111B v1.1
Agatha · TheDrummer
Params111B
Context128K
Q4_K_M67.1 GB
Tool use
LA
Lazarus 2407 100B
Lazarus · TheDrummer
Params100B
Context128K
Q4_K_M60.0 GB
Tool use

Keep browsing