GGUF models by bruhzair

358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
PR
Prototype 0.4x86
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x89
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x106
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x108
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x110
Prototype · bruhzair
Params105B
Context128K
Smallest86.0 GB
GGUF
PR
Prototype 0.4x114
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x115
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x127
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x149
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x152
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x159
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x166
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x188
Prototype · bruhzair
Params70.6B
Context8K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x192
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x193
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x232
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x233
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x241
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
prototype 0.4x255 Q8 0
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
prototype 0.4x257 Q8 0
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x258
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x280
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x50
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x121
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x142
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x206
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x82
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x32
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF

Keep browsing