Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
asm2asm yi 1.5b 100k float16
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
Yi 9B 200K
Yi · brittlewis12
Params8.83B
Context256K
Q4_K_M5.3 GB
YI
Yi 6B Chat Ablt
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
asm2asm yi 1.5b 10k float16
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
Boundary Coder Yi 2x6B MoE
Yi · mradermacher
Params10.4B
Context4K
Q4_K_M6.3 GB
YI
models--01-ai--Yi-1.5-6B-Chat
Yi · duolaf
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 1.5 34B Chat bpw2.25 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Bhenrym14 Airoboros 3_1 Yi 34b 200k
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
YI
Yi 1.5 9B Chat CMC
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 6B
Yi · SamPurkis
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 9B 200K
Yi · LoneStriker
Params8.83B
Context256K
Q4_K_M5.3 GB
YI
Yi 34B 200K
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
YI
yi 1.5 9b chat
Yi · neopolita
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Mermaid Yi 9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 6B 200K
Yi · LoneStriker
Params6.06B
Context195K
Q4_K_M3.7 GB
YI
SG Raccoon Yi 55B 200k
Yi · mradermacher
Params55.6B
Context195K
Q4_K_M33.3 GB
YI
Yi 6B 200k v2
Yi · MarsupialAI
Params6.06B
Context195K
Smallest3.0 GB
YI
01 Ai Yi 1.5 34B Chat 16K
Yi · tensorblock
Params34.4B
Context16K
Smallest12.8 GB
YI
01 Ai Yi 1.5 9B Chat 16K
Yi · tensorblock
Params8.83B
Context16K
Smallest3.4 GB
YI
Yi 34B GiftedConvo merged
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
YI
Fook-Yi-34B-32K-25p-Chat
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
Yi 6B Chat Ablt
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 34B v2
Yi · tensorblock
Params34.4B
Context8K
Smallest12.8 GB
YI
FX Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 6B Adv
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 34Bx2 MoE 60B
Yi · cloudyu
Params60.8B
Context195K
Smallest24.7 GB
YI
blossom v4 yi 34b
Yi · Azure99
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Nous Hermes 2 Yi 34B
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
YI
Yi 1.5 34B Chat bpw3.5 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 1.5 9B
Yi · Cran-May
Params8.83B
Context4K
Q4_K_M5.3 GB