GGUF models by TheDrummer
106 GGUF models quantized by TheDrummer on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.
CO
Star Command R 32B v1
Command R · TheDrummer
Params32.3B
Context128K
Q4_K_M19.8 GB
IN
MS Interleaved Upscale 39B
Interleaved · TheDrummer
Params39B
Context128K
Q4_K_M23.4 GB
EN
Endurance 100B v1.1
Endurance · TheDrummer
Params100B
Context128K
Q4_K_M60.0 GB
CO
Agatha 111B v1
Command R · TheDrummer
Params111B
Context256K
Q4_K_M67.1 GB
LL
Fallen Llama 3.3 R1 70B v1
Llama · TheDrummer
Params70.6B
Context128K
Q4_K_M42.5 GB
FA
Fallen Command A 111B V1B
Fallen · TheDrummer
Params111B
Context256K
Q4_K_M67.1 GB
MI
Mixtral 4x3B V1A Workspace
Mistral · TheDrummer
Params10.4B
Context32K
Q4_K_M6.3 GB
BE
Behemoth 123B v1.1
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
NA
Nautilus 70B v0.1
Nautilus · TheDrummer
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Cydonia ReduX 22B v1
Mistral · TheDrummer
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Behemoth ReduX 123B v1
Mistral · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
FA
Fallen Command A 111B v1.1
Fallen · TheDrummer
Params111B
Context256K
Q4_K_M67.1 GB
BE
Behemoth X 123B v2.1
Behemoth · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
LL
Fallen Llama 3.3 70B v1
Llama · TheDrummer
Params70.6B
Context128K
Q4_K_M42.5 GB
AG
Agatha 111B v1.1
Agatha · TheDrummer
Params111B
Context128K
Q4_K_M67.1 GB
LA
Lazarus 2407 100B
Lazarus · TheDrummer
Params100B
Context128K
Q4_K_M60.0 GB