GGUF models by bruhzair

358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
PR
Prototype 0.4x278
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x298
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
CO
Command t2 111b Q6 K L
Command · bruhzair
Params111B
Context256K
Smallest91.1 GB
GGUF
BA
Base10
Base · bruhzair
Params105B
Context128K
Smallest63.0 GB
Tool use
PR
Protofuel Author 1b
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Protofuel Mimic 1a
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Protofuel Author 1h
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x5
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x249
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x253
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x283
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
SA
San x2 t2 Q6 K M
San · bruhzair
Params91.1B
Context128K
Smallest74.7 GB
Tool use
CO
Command t3 111b Q6 K L
Command · bruhzair
Params111B
Context128K
Smallest91.1 GB
Tool use
CO
Command t5 111b Q6 K
Command · bruhzair
Params111B
Context256K
Smallest91.1 GB
GGUF
PR
Proxy5
Proxy · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Protofuel Mimic 1
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Protofuel Author 1e
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4g
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
proxy slerp2 70B Q4 K
Proxy · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
Tool use
PR
Prototype 0.4x128
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x289
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x158
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x167
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x223
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x303
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
CH
Chemical X t1 123b
Chemical · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
ME
Mega Slerp2
Mega · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
Tool use
PR
Prototype 0.4d
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x12
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x48
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF

Keep browsing