Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
dolphin-2.9.1-yi-9b
Yi · crusoeai
Params8.83B
Context12K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
YI
Yi 6b 200k Dpo
Yi · RichardErkhov
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
YI
Hermes-2.5-Yi-1.5-9B-Chat
Yi · juvi21
Params8.83B
Context4K
Q4_K_M5.3 GB
Tool use
YI
adamo1139 Yi 34B AEZAKMI v1
Yi · RichardErkhov
Params34B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · thesven
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
YI
Airoboros 3_1 Yi 34b 200k
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 34Bx2 MoE 60B
Yi · tensorblock
Params60.8B
Context195K
Smallest22.4 GB
GGUF
YI
Hyperion 3.0 Yi 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 34Bx2 MoE 60B
Yi · RichardErkhov
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · qwp4w3hyb
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
YI
Yi 34B 200K
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Libra Guard Yi 1.5 9B Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 34B 200K MiniOrca
Yi · RichardErkhov
Params34B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · afrideva
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Hercules-4.0-Yi-34B
Yi · bartowski
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
adamo1139 Yi 34B 200K AEZAKMI RAW TOXIC XLCTX 2303
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
01 Ai Yi 1.5 9B Chat
Yi · tensorblock
Params8.83B
Context4K
Smallest3.4 GB
GGUF
YI
Fook-Yi-34B-32K-v1
Yi · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 34B 32K Rebased 1406
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
01 Ai Yi 9B
Yi · tensorblock
Params8.83B
Context4K
Smallest3.4 GB
GGUF
YI
Fook-Yi-34B-v1a
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
Dolphin 2.9.1 Yi 1.5 34b Heretic
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
CodingTool use
YI
Faro Yi 9B
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Airoboros 3_1 Yi 34b 200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
yi 6B
Yi · Jezzarax
Params6.06B
Context4K
Smallest2.6 GB
GGUF
YI
yi 34b 200k rawrr dpo 1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
hyeogi Yi 6b v0.3
Yi · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
YI
Yi 6B 200K Airo Claude Puffin
Yi · LoneStriker
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF

Keep browsing