GGUF models by CHE-72

86 GGUF models quantized by CHE-72 on Hugging Face. Sizes run from 494M to 14B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
BR
Breeze-7B-Instruct-v1_0
Breeze · CHE-72
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen1.5-4B-Chat
Qwen · CHE-72
Params3.95B
Context32K
Smallest1.6 GB
GGUF
PH
Phi 3 mini 128k instruct Q6 K
Phi · CHE-72
Params3.82B
Context128K
Smallest3.1 GB
Coding
PH
Phi 3 medium 128k instruct Q5 0
Phi · CHE-72
Params14B
Context128K
Smallest9.6 GB
Coding
QW
Qwen2-1.5B-Instruct
Qwen · CHE-72
Params1.54B
Context32K
Smallest1.3 GB
GGUF
QW
Qwen2-7B-Instruct
Qwen · CHE-72
Params7.62B
Context32K
Smallest8.1 GB
GGUF
BR
Breeze-7B-Instruct-v1_0
Breeze · CHE-72
Params7.49B
Context32K
Smallest8.0 GB
GGUF
PH
Phi 3 medium 128k instruct Q4 K S
Phi · CHE-72
Params14B
Context128K
Smallest8.0 GB
Coding
QW
Qwen2-7B-Instruct
Qwen · CHE-72
Params7.62B
Context32K
Smallest5.3 GB
GGUF
PH
Phi 3 medium 128k instruct Q4 K M
Phi · CHE-72
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
Phi 3 medium 128k instruct Q3 K L
Phi · CHE-72
Params14B
Context128K
Smallest7.5 GB
Coding
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
TA
TAIDE-LX-7B-Chat
Taide · CHE-72
Params6.94B
Context4K
Q4_K_M4.2 GB
GGUF
QW
Qwen2-1.5B-Instruct
Qwen · CHE-72
Params1.54B
Context32K
Smallest1.6 GB
GGUF
PH
Phi 3 medium 128k instruct Q5 K S
Phi · CHE-72
Params14B
Context128K
Smallest9.6 GB
Coding
QW
Qwen1.5-4B-Chat
Qwen · CHE-72
Params3.95B
Context32K
Smallest2.8 GB
GGUF
QW
Qwen2-7B-Instruct
Qwen · CHE-72
Params7.62B
Context32K
Smallest3.0 GB
GGUF
QW
Qwen1.5-4B-Chat
Qwen · CHE-72
Params3.95B
Context32K
Smallest2.0 GB
GGUF
QW
Qwen2-7B-Instruct
Qwen · CHE-72
Params7.62B
Context32K
Smallest4.5 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest4.2 GB
GGUF
TA
TAIDE-LX-7B-Chat
Taide · CHE-72
Params6.94B
Context4K
Smallest4.9 GB
GGUF
TA
TAIDE-LX-7B-Chat
Taide · CHE-72
Params6.94B
Context4K
Smallest7.4 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest3.0 GB
GGUF
PH
Phi 3 medium 128k instruct Q4 0
Phi · CHE-72
Params14B
Context128K
Smallest7.9 GB
Coding
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest6.4 GB
GGUF
PH
Phi 3 medium 128k instruct Q6 K
Phi · CHE-72
Params14B
Context128K
Smallest11.5 GB
Coding
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest2.3 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest5.0 GB
GGUF
BA
Baichuan2-7B-Chat
Baichuan · CHE-72
Params7.51B
Context4K
Smallest8.0 GB
GGUF
TA
TAIDE-LX-7B-Chat
Taide · CHE-72
Params6.94B
Context4K
Smallest2.6 GB
GGUF

About CHE-72 on Hugging Face

CHE-72 has published 86 GGUF models that ggufmodels.com tracks, across families such as Qwen, Yi and Taide. The most downloaded are Breeze-7B-Instruct-v1_0, Qwen1.5-4B-Chat and Phi 3 mini 128k instruct Q6 K.

The quants CHE-72 publishes most often are Q8_0 (10), Q6_K (10), Q5_K_M (7) and Q5_0 (7). Their Q4_K_M files range from 2.5 to 8.6 GB. Parameter counts run from 494M to 14B, and the longest trained context window is 128K tokens.

Frequently asked questions

What GGUF models has CHE-72 published?

86 models are listed here, mainly from the Qwen, Yi and Taide families. The most downloaded is Breeze-7B-Instruct-v1_0.

Which quants does CHE-72 publish?

The most common are Q8_0 (10 models), Q6_K (10 models), Q5_K_M (7 models) and Q5_0 (7 models).

Keep browsing