Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
Fook-Yi-34B-v1a
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
Yi 1.5 34B Chat bpw5.5 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 1.5 9B Chat MBLC
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 1.5 34B Chat bpw4 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Brucethemoose Capybara Tess Yi 34B 200K
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
YI
lumynax chat yi 15 34b
Yi · AbteeXAILab
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 34b 200K AEZAKMI RAW 1701
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
YI
Yi-1.5-34B-32K
Yi · LoneStriker
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
Yi 34B 200K DARE Merge v5
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
TechxGenus CursorCore Yi 1.5B
Yi · RichardErkhov
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
blossom v3 1 yi 34b
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 1.5 34B Chat bpw3 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
bhenrym14 airoboros 3 1 yi 34b 200k iMat
Yi · Nexesenex
Params34.4B
Context195K
Smallest9.3 GB
YI
Abhishekchohan Yi 9B Forest DPO v1.0
Yi · tensorblock
Params8.83B
Context4K
Smallest3.4 GB
YI
Instruct Yi 6B Dolly15K
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
YI
Mermaid Yi 9B Factual Temps Full Synthetic
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 1.5 9B Chat
Yi · Kondara
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-34B-200K-XLCTX-RAW-ORPO-0805-GaLore
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · macadeliccc
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
Hyeogi Yi 6b Dpo v0.4
Yi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
YI
Yi-1.5-6B
Yi · afrideva
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Nous Hermes 2 Yi 34B
Yi · gguf
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
01 ai Yi 9B
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 6B 200k
Yi · SinpxAI
Params6.06B
Context195K
Q4_K_M3.7 GB
YI
Yi 6B Infinity Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
yi 6b 200k
Yi · neopolita
Params6.06B
Context195K
Q4_K_M3.7 GB
YI
Nous Hermes 2 Yi 34B IQ3 imatrix
Yi · patf82
Params34.4B
Context4K
Smallest15.0 GB
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi-1.5-6B-Chat
Yi · NikolayKozloff
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Hyperion 3.0 Yi 34B
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB