GGUF models by bruhzair
358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.
PR
Prototype 0.4x191
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x194
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x220
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x227
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x240
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x243
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x259
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
PR
Prototype 0.4x2
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
prototype 0.2 Q4 K
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x8
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x15
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x18
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x20
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x21
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x22
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x27
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x28
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x29
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x30
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x31
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x33
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x49
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
PR
Prototype 0.4x54
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x55
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x72
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x74
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x75
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x73
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
Prototype 0.4x76
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
PR
prototype 0.4x780 Q6 K
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB