GGUF models by bruhzair
358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.
PR
Prototype 0.4x60
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x134
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x146
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x148
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x161
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x160
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x207
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x215
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x219
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x237
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x261
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x269
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x292
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x309
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x321
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
LO
Lovecraft Test3 123b
Lovecraft · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
GI
GigaMag Behemoth Q4 K M
Gigamag · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
MI
Mixcraftz 123b Q4 K M
Mixcraftz · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
TI
Titan 123b
Titan · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
SA
San x2 t1 Q5 K M
San · bruhzair
Params105B
Context128K
Smallest74.1 GB
BR
Cu x2 Q5 K M
Bruhzair · bruhzair
Params105B
Context128K
Smallest74.1 GB
TE
Test Model 20
Test · bruhzair
Params105B
Context128K
Smallest63.0 GB
AL
Alpha Model 1.2
Alpha · bruhzair
Params105B
Context128K
Smallest63.0 GB
TE
Test Model 24
Test · bruhzair
Params105B
Context128K
Smallest63.0 GB
AH
AHN Slerp1
Ahn · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
SL
rp slerp redo Q4 K
Slerp · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
AU
Author Base7
Author · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
prototype 0.4x11 Q4 K
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x126
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x143
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB