Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
Yi-1.5-34B-Chat
Yi · vsevolodl
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
TechxGenus CursorCore Yi 1.5B LC
Yi · RichardErkhov
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
TechxGenus Yi 9B Coder
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-9b-v1
Yi · RichardErkhov
Params8.95B
Context2K
Q4_K_M5.4 GB
YI
Tess 2.0 Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 6B Chat
Yi · second-state
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Wenbopan Faro Yi 9B DPO
Yi · tensorblock
Params8.83B
Context32K
Smallest3.4 GB
YI
Walmart the bag Yi 6B Infinity Chat
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Fook-Yi-34B-32K-v1a
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
Yi-1.5-6B-Chat
Yi · MoMonir
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 1.5 9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Master-Yi-9B
Yi · qnguyen3
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 6b Dpo v0.4
Yi · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
YI
yi 34b 200k
Yi · neopolita
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
yi 1.5 6b chat
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Med-Yi-1.5-9B
Yi · RichardErkhov
Params8.83B
Context8K
Q4_K_M5.3 GB
YI
Yi-1.5-dolphin-9B
Yi · RichardErkhov
Params8.83B
Context8K
Q4_K_M5.3 GB
YI
Yi 6B yoruno
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Fook-Yi-34B-32K-25p-Chat
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
Yi 34b 200K alpaca rpv3 scipy
Yi · zgce
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 34B 200K RPMerge
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Tess 2.0 Yi 34B 200K
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 6B 200K
Yi · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB
YI
Yi 9B 200K
Yi · bartowski
Params8.83B
Context256K
Q4_K_M5.3 GB
YI
Yi 6b Dpo v0.1
Yi · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
YI
Yi 1.5 9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 34b Chat Spicyboros limarpv3
Yi · zgce
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
YI-7B-Nicky1
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · LoneStriker
Params34.4B
Context8K
Q4_K_M20.7 GB
YI
ahmedheakl asm2asm yi 1.5b 100k float16 attn
Yi · RichardErkhov
Params1.48B
Context128K
Q4_K_M1.0 GB