GGUF models by bruhzair

358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
PR
Prototype 0.4x60
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x134
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x146
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x148
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x161
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x160
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x207
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x215
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x219
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x237
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x261
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x269
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x292
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x309
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x321
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
LO
Lovecraft Test3 123b
Lovecraft · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
GI
GigaMag Behemoth Q4 K M
Gigamag · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
MI
Mixcraftz 123b Q4 K M
Mixcraftz · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
TI
Titan 123b
Titan · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
SA
San x2 t1 Q5 K M
San · bruhzair
Params105B
Context128K
Smallest74.1 GB
Tool use
BR
Cu x2 Q5 K M
Bruhzair · bruhzair
Params105B
Context128K
Smallest74.1 GB
Tool use
TE
Test Model 20
Test · bruhzair
Params105B
Context128K
Smallest63.0 GB
Tool use
AL
Alpha Model 1.2
Alpha · bruhzair
Params105B
Context128K
Smallest63.0 GB
Tool use
TE
Test Model 24
Test · bruhzair
Params105B
Context128K
Smallest63.0 GB
Tool use
AH
AHN Slerp1
Ahn · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
Tool use
SL
rp slerp redo Q4 K
Slerp · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
RoleplayTool use
AU
Author Base7
Author · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
Tool use
PR
prototype 0.4x11 Q4 K
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x126
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x143
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF

Keep browsing