Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
Yi 1.5 9B Chat 16K Abliterated
Yi · RichardErkhov
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
YI
Hercules 4.0 Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
GGUF
YI
Hyperion 2.0 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
GGUF
YI
ahmedheakl asm2asm yi 1.5b 1k float16
Yi · RichardErkhov
Params1.48B
Context128K
Q4_K_M1.0 GB
GGUF
YI
Yi-1.5-34B-32K
Yi · redponike
Params34.4B
Context32K
Smallest15.0 GB
GGUF
YI
cloudyu Yi 34Bx2 MOE 200K
Yi · RichardErkhov
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
YI
Boundary Coder Yi 2x9B MoE
Yi · mradermacher
Params15.3B
Context256K
Q4_K_M9.3 GB
Coding
YI
Magnum Yi 34b Q4 K M
Yi · SzilviaB
Params34.4B
Context4K
Q4_K_M41.3 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · LiteLLMs
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Airoboros 3_1 Yi 34b 200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi-9B-Coder
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
Coding
YI
01 Ai Yi 9B 200K
Yi · tensorblock
Params8.83B
Context256K
Smallest3.4 GB
GGUF
YI
yi 1.5
Yi · cortexso
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Fook-Yi-34B-32K-v1
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
Faro Yi 9B DPO iMat
Yi · qwp4w3hyb
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Tess 2.0 Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
cloudyu Yi 34Bx2 MoE 60B
Yi · RichardErkhov
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
YI
CursorCore Yi 1.5B LC
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
YI
Locutusque Hercules 4.0 Yi 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 34B 200K RPMerge
Yi · MarsupialAI
Params34.4B
Context195K
Smallest15.0 GB
GGUF
YI
Yi 34B 200K AEZAKMI v2
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 34B Chat bpw4.6 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 70B 200k RPMerge Franken
Yi · mradermacher
Params71.2B
Context195K
Q4_K_M42.6 GB
GGUF
YI
Capybara Tess Yi 34B 200K DARE Ties
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 6B Chat spicy
Yi · zgce
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 1.5 9B Chat
Yi · cstr
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 6B Open Orca
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M4.0 GB
GGUF
YI
Yi 1.5 34B Chat bpw2.5 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · larenspear
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 1.5 6B Chat
Yi · tsunemoto
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF

Keep browsing