GGUF models by bruhzair
358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.
PR
prototype 0.4x225 Q6 K
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x81
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x187
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x123
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x129
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x210
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x250
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
TE
Test Model 27
Test · bruhzair
Params105B
Context128K
Smallest63.0 GB
AU
Author Base6
Author · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
protofuel author 1m Q4 K
Protofuel · bruhzair
Params70.6B
Context8K
Smallest42.5 GB
AU
Author Base1
Author · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Proxy6
Proxy · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x157
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x302
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x45
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x141
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x151
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x326
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x4
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x169
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x195
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x235
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
proxy9 70B Q6 K
Proxy · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Protofuel Author 1p
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x252
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x319
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
protoype 0.4c 70B Q4 K
Protoype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x197
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x300
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x176
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB