GGUF models by bruhzair

358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
PR
Prototype 0.4x204
Prototype · bruhzair
Params70.6B
Context8K
Smallest57.9 GB
GGUF
PR
Prototype 123x3
Prototype · bruhzair
Params123B
Context128K
Smallest73.2 GB
GGUF
PR
Prototype 0.4x136
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
prototype 0.4x248 Q8 0
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
TE
Test Model 1 SCE
Test · bruhzair
Params105B
Context128K
Smallest63.0 GB
Tool use
PR
Prototype 0.4x229
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x276
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x282
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
TE
Test Model 1
Test · bruhzair
Params105B
Context128K
Smallest63.0 GB
Tool use
AU
Author Base3
Author · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
Tool use
PR
Protofuel Author 1k
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
EL
Electra R1 70b Q6 K f32 theory test
Electra · bruhzair
Params70.6B
Context128K
Smallest64.6 GB
ReasoningTool use
PR
Prototype 0.4x274
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x251
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x26
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x231
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
MU
Mutant Writer t6 123b Q4 K M
Mutant · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
IG
ignore base3 Q6 K
Ignore · bruhzair
Params105B
Context128K
Smallest86.0 GB
GGUF
AH
AHV slerp Q4 K
Ahv · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
AU
Author Base8
Author · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
Tool use
PR
Prototype 0.4f
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
AU
Author Base10
Author · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x323
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x310
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Proxy3
Proxy · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x88
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
MU
Mutant Writer t3 123b Q4 K M
Mutant · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
PR
Prototype 0.4x132
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x213
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x272
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF

Keep browsing