GGUF models by bruhzair

358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
AL
Alpha Model 1b 105B
Alpha · bruhzair
Params105B
Context128K
Smallest63.0 GB
Tool use
PR
prototype 0.4x144 Q6 K
Prototype · bruhzair
Params70.6B
Context128K
Smallest47.9 GB
GGUF
PR
prototype 0.4x216 Q6 K
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x164
Prototype · bruhzair
Params70.6B
Context8K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x332
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x244
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x335
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x318
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x224
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x331
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
protofuel author 1i Q4 K
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x281
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x295
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x301
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x131
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x156
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x205
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x315
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x296
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Protofuel Author 1a
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x125
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x154
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x122
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Protofuel Author 1l
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
prototype 0.4x333 Q8 0
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x316
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x290
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x179
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x320
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x71
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF

About bruhzair on Hugging Face

bruhzair has published 358 GGUF models that ggufmodels.com tracks, across families such as Prototype, Protofuel and Proxy. The most downloaded are Alpha Model 1b 105B, prototype 0.4x144 Q6 K and prototype 0.4x216 Q6 K.

The quants bruhzair publishes most often are Q6_K (140), Q4_K (118), Q8_0 (82) and Q4_K_M (11). Their Q4_K_M files range from 63.0 to 73.2 GB. Parameter counts run from 70.6B to 123B, and the longest trained context window is 256K tokens.

Frequently asked questions

What GGUF models has bruhzair published?

358 models are listed here, mainly from the Prototype, Protofuel and Proxy families. The most downloaded is Alpha Model 1b 105B.

Which quants does bruhzair publish?

The most common are Q6_K (140 models), Q4_K (118 models), Q8_0 (82 models) and Q4_K_M (11 models).

Keep browsing