GGUF models by bruhzair
358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.
PR
Prototype 0.4x107
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x163
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x271
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x284
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x307
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
MU
Mutant Writer t4 123b Q4 K M
Mutant · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
AL
Alpha Model 1b
Alpha · bruhzair
Params105B
Context128K
Smallest63.0 GB
TA
tales slerp1 Q4 K
Tales · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4e
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x34
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x116
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x263
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x264
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x299
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
CU
Cui x2 t1 Q5 K M
Cui · bruhzair
Params105B
Context128K
Smallest74.1 GB
IG
ignore base2 Q4 K
Ignore · bruhzair
Params105B
Context128K
Smallest63.0 GB
GR
Group2 A
Group · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x314
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
CU
Cui x2 t2 Q5 K M
Cui · bruhzair
Params105B
Context128K
Smallest74.1 GB
PR
Prototype 0.4x334
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x212
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x291
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x328
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x7
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x84
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x137
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x147
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x178
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x208
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x226
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB