Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
Yi 1.5 9B Chat 16K Abliterated
Yi · RichardErkhov
Params8.83B
Context16K
Q4_K_M5.3 GB
YI
Hercules 4.0 Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
YI
Hyperion 2.0 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
YI
ahmedheakl asm2asm yi 1.5b 1k float16
Yi · RichardErkhov
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
Yi-1.5-34B-32K
Yi · redponike
Params34.4B
Context32K
Smallest15.0 GB
YI
cloudyu Yi 34Bx2 MOE 200K
Yi · RichardErkhov
Params60.8B
Context195K
Q4_K_M36.7 GB
YI
Boundary Coder Yi 2x9B MoE
Yi · mradermacher
Params15.3B
Context256K
Q4_K_M9.3 GB
YI
Magnum Yi 34b Q4 K M
Yi · SzilviaB
Params34.4B
Context4K
Q4_K_M41.3 GB
YI
Yi-1.5-34B-Chat
Yi · LiteLLMs
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Airoboros 3_1 Yi 34b 200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi-9B-Coder
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
01 Ai Yi 9B 200K
Yi · tensorblock
Params8.83B
Context256K
Smallest3.4 GB
YI
yi 1.5
Yi · cortexso
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Fook-Yi-34B-32K-v1
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
Faro Yi 9B DPO iMat
Yi · qwp4w3hyb
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
Tess 2.0 Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
cloudyu Yi 34Bx2 MoE 60B
Yi · RichardErkhov
Params60.8B
Context195K
Q4_K_M36.7 GB
YI
CursorCore Yi 1.5B LC
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
Locutusque Hercules 4.0 Yi 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 34B 200K RPMerge
Yi · MarsupialAI
Params34.4B
Context195K
Smallest15.0 GB
YI
Yi 34B 200K AEZAKMI v2
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 1.5 34B Chat bpw4.6 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 70B 200k RPMerge Franken
Yi · mradermacher
Params71.2B
Context195K
Q4_K_M42.6 GB
YI
Capybara Tess Yi 34B 200K DARE Ties
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 6B Chat spicy
Yi · zgce
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 1.5 9B Chat
Yi · cstr
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 6B Open Orca
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M4.0 GB
YI
Yi 1.5 34B Chat bpw2.5 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-9B-Chat
Yi · larenspear
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 1.5 6B Chat
Yi · tsunemoto
Params6.06B
Context4K
Q4_K_M3.7 GB