GGUF models by bruhzair

358 GGUF models quantized by bruhzair on Hugging Face. Sizes run from 70.6B to 123B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
PR
Prototype 0.4x267
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x268
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x270
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x273
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x277
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x285
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x286
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x287
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x297
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x304
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x305
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x306
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x311
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x324
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
GI
Giga Tess 0.1
Giga · bruhzair
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
CU
Cui x2 t1 Q4 K M
Cui · bruhzair
Params105B
Context128K
Q4_K_M63.0 GB
Tool use
BA
Base11
Base · bruhzair
Params105B
Context128K
Smallest63.0 GB
Tool use
AL
Alpha Model 1
Alpha · bruhzair
Params105B
Context128K
Smallest63.0 GB
GGUF
TE
Test Model 22
Test · bruhzair
Params105B
Context128K
Smallest63.0 GB
Tool use
SL
Rp Slerp2
Slerp · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
RoleplayTool use
PR
Proxy5
Proxy · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Proxy11
Proxy · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
GR
Group2 A2
Group · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Protofuel Author 1c
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Protofuel Author 1f
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Protofuel Author 1n
Protofuel · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Protofuel Author 1o
Protofuel · bruhzair
Params70.6B
Context8K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x99
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x109
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x119
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF

Keep browsing