GGUF models by CHE-72
86 GGUF models quantized by CHE-72 on Hugging Face. Sizes run from 494M to 14B parameters. The longest trained context is 128K tokens.
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest3.5 GB
BA
Baichuan2-7B-Chat
Baichuan · CHE-72
Params7.51B
Context4K
Smallest4.1 GB
QW
Qwen1.5-4B-Chat
Qwen · CHE-72
Params3.95B
Context32K
Smallest3.2 GB
QW
Qwen2-7B-Instruct
Qwen · CHE-72
Params7.62B
Context32K
Smallest6.3 GB
BA
Baichuan2-7B-Chat
Baichuan · CHE-72
Params7.51B
Context4K
Smallest3.8 GB
TA
TAIDE-LX-7B-Chat
Taide · CHE-72
Params6.94B
Context4K
Smallest4.0 GB
BA
Baichuan2-7B-Chat
Baichuan · CHE-72
Params7.51B
Context4K
Q4_K_M4.6 GB
BR
Breeze-7B-Instruct-v1_0
Breeze · CHE-72
Params7.49B
Context32K
Smallest5.2 GB
BR
Breeze-7B-Instruct-v1_0
Breeze · CHE-72
Params7.49B
Context32K
Smallest5.3 GB
BA
Baichuan2-7B-Chat
Baichuan · CHE-72
Params7.51B
Context4K
Smallest5.4 GB
BA
Baichuan2-7B-Chat
Baichuan · CHE-72
Params7.51B
Context4K
Smallest5.2 GB
QW
Qwen1.5-4B-Chat
Qwen · CHE-72
Params3.95B
Context32K
Smallest2.8 GB
TA
TAIDE-LX-7B-Chat
Taide · CHE-72
Params6.94B
Context4K
Smallest4.0 GB
QW
Qwen1.5-4B-Chat
Qwen · CHE-72
Params3.95B
Context32K
Smallest2.3 GB
BR
Breeze-7B-Instruct-v1_0
Breeze · CHE-72
Params7.49B
Context32K
Smallest4.3 GB
BR
Breeze-7B-Instruct-v1_0
Breeze · CHE-72
Params7.49B
Context32K
Smallest4.3 GB
TA
TAIDE-LX-7B-Chat
Taide · CHE-72
Params6.94B
Context4K
Smallest3.4 GB
BR
Breeze-7B-Instruct-v1_0
Breeze · CHE-72
Params7.49B
Context32K
Smallest3.3 GB
BR
Breeze-7B-Instruct-v1_0
Breeze · CHE-72
Params7.49B
Context32K
Smallest2.9 GB
TA
TAIDE-LX-7B-Chat
Taide · CHE-72
Params6.94B
Context4K
Smallest3.1 GB
TA
TAIDE-LX-7B-Chat
Taide · CHE-72
Params6.94B
Context4K
Smallest5.7 GB
BA
Baichuan2-7B-Chat
Baichuan · CHE-72
Params7.51B
Context4K
Smallest3.4 GB
TA
TAIDE-LX-7B-Chat
Taide · CHE-72
Params6.94B
Context4K
Smallest4.8 GB
BR
Breeze-7B-Instruct-v1_0
Breeze · CHE-72
Params7.49B
Context32K
Smallest4.0 GB
TA
TAIDE-LX-7B-Chat
Taide · CHE-72
Params6.94B
Context4K
Smallest3.7 GB
BA
Baichuan2-7B-Chat
Baichuan · CHE-72
Params7.51B
Context4K
Smallest5.2 GB