GGUF models by bruhzair
358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.
PR
Prototype 0.4x86
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x89
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x106
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x108
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x110
Prototype · bruhzair
Params105B
Context128K
Smallest86.0 GB
PR
Prototype 0.4x114
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x115
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x127
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x149
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x152
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x159
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x166
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x188
Prototype · bruhzair
Params70.6B
Context8K
Smallest42.5 GB
PR
Prototype 0.4x192
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x193
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x232
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x233
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x241
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
prototype 0.4x255 Q8 0
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
prototype 0.4x257 Q8 0
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x258
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x280
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x50
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x121
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x142
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x206
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x82
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x32
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB