GGUF models by bruhzair
358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.
PR
Prototype 0.4x204
Prototype · bruhzair
Params70.6B
Context8K
Smallest57.9 GB
PR
Prototype 123x3
Prototype · bruhzair
Params123B
Context128K
Smallest73.2 GB
PR
Prototype 0.4x136
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
prototype 0.4x248 Q8 0
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
TE
Test Model 1 SCE
Test · bruhzair
Params105B
Context128K
Smallest63.0 GB
PR
Prototype 0.4x229
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x276
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x282
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
TE
Test Model 1
Test · bruhzair
Params105B
Context128K
Smallest63.0 GB
AU
Author Base3
Author · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Protofuel Author 1k
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
EL
Electra R1 70b Q6 K f32 theory test
Electra · bruhzair
Params70.6B
Context128K
Smallest64.6 GB
PR
Prototype 0.4x274
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x251
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x26
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x231
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
MU
Mutant Writer t6 123b Q4 K M
Mutant · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
IG
ignore base3 Q6 K
Ignore · bruhzair
Params105B
Context128K
Smallest86.0 GB
AH
AHV slerp Q4 K
Ahv · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
AU
Author Base8
Author · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4f
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
AU
Author Base10
Author · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x323
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x310
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Proxy3
Proxy · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x88
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
MU
Mutant Writer t3 123b Q4 K M
Mutant · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
PR
Prototype 0.4x132
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x213
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x272
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB