GGUF models by bruhzair
358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.
PR
Prototype 0.4x267
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x268
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x270
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x273
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x277
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x285
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x286
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x287
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x297
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x304
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x305
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x306
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x311
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x324
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GI
Giga Tess 0.1
Giga · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
CU
Cui x2 t1 Q4 K M
Cui · bruhzair
Params105B
Context128K
Q4_K_M63.0 GB
BA
Base11
Base · bruhzair
Params105B
Context128K
Smallest63.0 GB
AL
Alpha Model 1
Alpha · bruhzair
Params105B
Context128K
Smallest63.0 GB
TE
Test Model 22
Test · bruhzair
Params105B
Context128K
Smallest63.0 GB
SL
Rp Slerp2
Slerp · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Proxy5
Proxy · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Proxy11
Proxy · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GR
Group2 A2
Group · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Protofuel Author 1c
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Protofuel Author 1f
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Protofuel Author 1n
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Protofuel Author 1o
Protofuel · bruhzair
Params70.6B
Context8K
Smallest42.5 GB
PR
Prototype 0.4x99
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x109
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x119
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB