Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
dolphin-2.9.1-yi-9b
Yi · crusoeai
Params8.83B
Context12K
Q4_K_M5.3 GB
YI
Yi-1.5-34B-Chat-16K
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
YI
Yi 6b 200k Dpo
Yi · RichardErkhov
Params6.06B
Context195K
Q4_K_M3.7 GB
YI
Hermes-2.5-Yi-1.5-9B-Chat
Yi · juvi21
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
adamo1139 Yi 34B AEZAKMI v1
Yi · RichardErkhov
Params34B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-9B-Chat
Yi · thesven
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-1.5-34B-Chat-16K
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
YI
Airoboros 3_1 Yi 34b 200k
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 34Bx2 MoE 60B
Yi · tensorblock
Params60.8B
Context195K
Smallest22.4 GB
YI
Hyperion 3.0 Yi 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 34Bx2 MoE 60B
Yi · RichardErkhov
Params60.8B
Context195K
Q4_K_M36.7 GB
YI
Yi-1.5-34B-Chat-16K
Yi · qwp4w3hyb
Params34.4B
Context16K
Q4_K_M20.7 GB
YI
Yi 34B 200K
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Libra Guard Yi 1.5 9B Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 34B 200K MiniOrca
Yi · RichardErkhov
Params34B
Context195K
Q4_K_M20.7 GB
YI
Yi-1.5-9B-Chat
Yi · afrideva
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Hercules-4.0-Yi-34B
Yi · bartowski
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
adamo1139 Yi 34B 200K AEZAKMI RAW TOXIC XLCTX 2303
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
01 Ai Yi 1.5 9B Chat
Yi · tensorblock
Params8.83B
Context4K
Smallest3.4 GB
YI
Fook-Yi-34B-32K-v1
Yi · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
Yi 1.5 34B 32K Rebased 1406
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
01 Ai Yi 9B
Yi · tensorblock
Params8.83B
Context4K
Smallest3.4 GB
YI
Fook-Yi-34B-v1a
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
Dolphin 2.9.1 Yi 1.5 34b Heretic
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
YI
Faro Yi 9B
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
Airoboros 3_1 Yi 34b 200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
yi 6B
Yi · Jezzarax
Params6.06B
Context4K
Smallest2.6 GB
YI
yi 34b 200k rawrr dpo 1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
hyeogi Yi 6b v0.3
Yi · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
YI
Yi 6B 200K Airo Claude Puffin
Yi · LoneStriker
Params6.06B
Context195K
Q4_K_M3.7 GB