GGUF models by HyzeAI

37 GGUF models quantized by HyzeAI on Hugging Face. Sizes run from 135M to 30.5B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Hyze1BInstruct
Llama · HyzeAI
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
HY
HyzeMini V2
Hyzemini · HyzeAI
Params354M
Context125K
Q4_K_M0.2 GB
CodingTool use
HY
HyzeQwenInstruct
Hyzeqweninstruct · HyzeAI
Params30.5B
Context256K
Smallest32.5 GB
Tool useVision
HY
HyzeMini V2 400M
Hyzemini · HyzeAI
Params354M
Context125K
Smallest0.3 GB
Coding
HY
HyzeMini V2 400M
Hyzemini · HyzeAI
Params354M
Context125K
Smallest0.2 GB
Coding
HY
HyzeMini V2 400M
Hyzemini · HyzeAI
Params354M
Context125K
Smallest0.2 GB
Coding
HY
HyzeMini
Hyzemini · HyzeAI
Params135M
Context8K
Smallest0.1 GB
Coding
HY
HyzeQwenInstruct
Hyzeqweninstruct · HyzeAI
Params30.5B
Context256K
Smallest14.7 GB
Tool useVision
HY
HyzeMini
Hyzemini · HyzeAI
Params135M
Context8K
Smallest0.1 GB
Coding
HY
HyzeMini
Hyzemini · HyzeAI
Params135M
Context8K
Smallest0.1 GB
Coding
HY
HyzeMini
Hyzemini · HyzeAI
Params135M
Context8K
Smallest0.1 GB
Coding
HY
HyzeMini V2 400M
Hyzemini · HyzeAI
Params354M
Context125K
Smallest0.3 GB
Coding
HY
HyzeMini V2 400M
Hyzemini · HyzeAI
Params354M
Context125K
Q4_K_M0.2 GB
Coding
HY
HyzeQwenInstruct
Hyzeqweninstruct · HyzeAI
Params30.5B
Context256K
Smallest17.3 GB
Tool useVision
HY
HyzeMini
Hyzemini · HyzeAI
Params135M
Context8K
Smallest0.1 GB
Coding
HY
HyzeMini
Hyzemini · HyzeAI
Params135M
Context8K
Smallest0.1 GB
Coding
HY
HyzeMini V2 400M
Hyzemini · HyzeAI
Params354M
Context125K
Smallest0.2 GB
Coding
HY
HyzeMini V2 400M
Hyzemini · HyzeAI
Params354M
Context125K
Smallest0.2 GB
Coding
HY
HyzeMini
Hyzemini · HyzeAI
Params135M
Context8K
Q4_K_M0.1 GB
Coding
HY
HyzeMini V2 400M
Hyzemini · HyzeAI
Params354M
Context125K
Smallest0.2 GB
Coding
HY
HyzeMini V2 400M
Hyzemini · HyzeAI
Params354M
Context125K
Smallest0.3 GB
Coding
HY
HyzeMini V2 400M
Hyzemini · HyzeAI
Params354M
Context125K
Smallest0.2 GB
Coding
HY
HyzeMini V2 400M
Hyzemini · HyzeAI
Params354M
Context125K
Smallest0.3 GB
Coding
HY
HyzeMini V2 400M
Hyzemini · HyzeAI
Params354M
Context125K
Smallest0.4 GB
Coding
HY
HyzeMini
Hyzemini · HyzeAI
Params135M
Context8K
Smallest0.1 GB
Coding
HY
HyzeMini
Hyzemini · HyzeAI
Params135M
Context8K
Smallest0.1 GB
Coding
HY
HyzeQwenInstruct
Hyzeqweninstruct · HyzeAI
Params30.5B
Context256K
Smallest13.3 GB
Tool useVision
HY
HyzeQwenInstruct
Hyzeqweninstruct · HyzeAI
Params30.5B
Context256K
Smallest21.1 GB
Tool useVision
HY
HyzeMini
Hyzemini · HyzeAI
Params135M
Context8K
Smallest0.1 GB
Coding
HY
HyzeQwenInstruct
Hyzeqweninstruct · HyzeAI
Params30.5B
Context256K
Smallest21.7 GB
Tool useVision

About HyzeAI on Hugging Face

HyzeAI has published 37 GGUF models that ggufmodels.com tracks, across families such as Hyzemini, Hyzeqweninstruct and Llama. The most downloaded are Hyze1BInstruct, HyzeMini V2 and HyzeQwenInstruct.

The quants HyzeAI publishes most often are Q8_0 (5), Q6_K (5), Q5_K_M (5) and Q4_K_M (5). Their Q4_K_M files range from 0.1 to 18.6 GB. Parameter counts run from 135M to 30.5B, and the longest trained context window is 256K tokens.

Frequently asked questions

What GGUF models has HyzeAI published?

37 models are listed here, mainly from the Hyzemini, Hyzeqweninstruct and Llama families. The most downloaded is Hyze1BInstruct.

Which quants does HyzeAI publish?

The most common are Q8_0 (5 models), Q6_K (5 models), Q5_K_M (5 models) and Q4_K_M (5 models).

Keep browsing