GGUF models by bruhzair
358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.
PR
Prototype 0.4x162
Prototype · bruhzair
Params70.6B
Context8K
Smallest57.9 GB
PR
Prototype 0.4x230
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x238
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x275
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x312
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x322
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
TI
Titan 123b 0.2 Q4 K M
Titan · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
CO
Command t4 111b Q6 K
Command · bruhzair
Params111B
Context256K
Smallest91.1 GB
AU
Author Base5
Author · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GR
Group2 A3
Group · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x317
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x313
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x3
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Proxy8
Proxy · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Protofuel Author 1d
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Protofuel Author 1g
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x17
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x23
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x52
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x256
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
EV
eva2 Q4 K
Eva · bruhzair
Params105B
Context128K
Smallest63.0 GB
AL
Alpha Model 1.1
Alpha · bruhzair
Params105B
Context128K
Smallest63.0 GB
PR
prototype 0.1 Q4 K
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x14
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x24
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x38
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x41
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x46
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x51
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x56
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB