GGUF models by bruhzair

358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
PR
Prototype 0.4x191
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x194
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x220
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x227
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x240
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x243
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x259
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x2
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
prototype 0.2 Q4 K
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x8
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x15
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x18
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x20
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x21
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x22
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x27
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x28
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x29
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x30
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x31
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x33
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x49
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x54
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x55
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x72
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x74
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x75
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x73
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x76
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
prototype 0.4x780 Q6 K
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF

Keep browsing