GGUF models by bruhzair

358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
PR
Prototype 0.4x162
Prototype · bruhzair
Params70.6B
Context8K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x230
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x238
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x275
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x312
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x322
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
TI
Titan 123b 0.2 Q4 K M
Titan · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
CO
Command t4 111b Q6 K
Command · bruhzair
Params111B
Context256K
Smallest91.1 GB
GGUF
AU
Author Base5
Author · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
Tool use
GR
Group2 A3
Group · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x317
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x313
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x3
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Proxy8
Proxy · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Protofuel Author 1d
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Protofuel Author 1g
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x17
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x23
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x52
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x256
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
EV
eva2 Q4 K
Eva · bruhzair
Params105B
Context128K
Smallest63.0 GB
GGUF
AL
Alpha Model 1.1
Alpha · bruhzair
Params105B
Context128K
Smallest63.0 GB
Tool use
PR
prototype 0.1 Q4 K
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x14
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x24
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x38
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x41
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x46
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x51
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x56
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF

Keep browsing