GGUF models by HyzeAI
37 GGUF models quantized by HyzeAI on Hugging Face. Sizes run from 135M to 30.5B parameters. The longest trained context is 256K tokens.
HY
HyzeQwenInstruct
Hyzeqweninstruct · HyzeAI
Params30.5B
Context256K
Smallest11.3 GB
HY
HyzeMini
Hyzemini · HyzeAI
Params135M
Context8K
Smallest0.1 GB
HY
HyzeQwenInstruct
Hyzeqweninstruct · HyzeAI
Params30.5B
Context256K
Smallest25.1 GB
HY
HyzeQwenInstruct
Hyzeqweninstruct · HyzeAI
Params30.5B
Context256K
Q4_K_M18.6 GB
HY
HyzeQwenInstruct
Hyzeqweninstruct · HyzeAI
Params30.5B
Context256K
Smallest15.9 GB
HY
HyzeQwenInstruct
Hyzeqweninstruct · HyzeAI
Params30.5B
Context256K
Smallest17.5 GB
HY
HyzeQwenInstruct
Hyzeqweninstruct · HyzeAI
Params30.5B
Context256K
Smallest21.1 GB