GGUF models by bruhzair
358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.
PR
Prototype 0.4x278
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x298
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
CO
Command t2 111b Q6 K L
Command · bruhzair
Params111B
Context256K
Smallest91.1 GB
BA
Base10
Base · bruhzair
Params105B
Context128K
Smallest63.0 GB
PR
Protofuel Author 1b
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Protofuel Mimic 1a
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Protofuel Author 1h
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x5
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x249
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x253
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x283
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
SA
San x2 t2 Q6 K M
San · bruhzair
Params91.1B
Context128K
Smallest74.7 GB
CO
Command t3 111b Q6 K L
Command · bruhzair
Params111B
Context128K
Smallest91.1 GB
CO
Command t5 111b Q6 K
Command · bruhzair
Params111B
Context256K
Smallest91.1 GB
PR
Proxy5
Proxy · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Protofuel Mimic 1
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Protofuel Author 1e
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4g
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
proxy slerp2 70B Q4 K
Proxy · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x128
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x289
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x158
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x167
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x223
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x303
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
CH
Chemical X t1 123b
Chemical · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
ME
Mega Slerp2
Mega · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4d
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x12
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x48
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB