Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
Yi 34Bx2 MOE 200K
Yi · cloudyu
Params60.8B
Context195K
Q4_K_M36.7 GB
YI
Yi-1.5-9B-Chat
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest7.2 GB
YI
Edgerunners_yi-9b-may-ortho-baukit-30fail-3000total-bf16
Yi · lucyknada
Params8.83B
Context4K
Smallest4.3 GB
YI
Yi-1.5-6B-Chat
Yi · ZeroWw
Params6.06B
Context4K
Smallest5.0 GB
YI
01 Ai Yi 1.5 9B 32K
Yi · tensorblock
Params8.83B
Context32K
Smallest3.4 GB
YI
01 Ai Yi 1.5 34B
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
YI
Yi-1.5-34B-Chat-16K
Yi · leafspark
Params34.4B
Context16K
Smallest28.2 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest28.2 GB
YI
Yi 1.5 6B Chat
Yi · itlwas
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi-1.5-9B-Chat
Yi · ByteBrew23
Params8.83B
Context4K
Smallest6.3 GB
YI
qw yi 9b
Yi · paul-stansifer
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 1.5 34B Chat bpw4.4 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
01 Ai Yi 1.5 9B
Yi · tensorblock
Params8.83B
Context4K
Smallest3.4 GB
YI
Yi-6B-200K
Yi · Angel367
Params6.06B
Context195K
Q4_K_M3.7 GB
YI
Yi 1.5 34B Chat bpw4.8 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 1.5 9B Chat 16K Q5 K M
Yi · leafspark
Params8.83B
Context16K
Smallest6.3 GB
YI
Yi-1.5-34B-Chat-16K
Yi · leafspark
Params34.4B
Context16K
Smallest12.8 GB
YI
Yi 1.5 9B Chat
Yi · itlwas
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
EVA Yi 1.5 9B 32K V1 Q8 0
Yi · Nothing448
Params8.83B
Context32K
Smallest9.4 GB
YI
Yi 1.5 34B Chat
Yi · itlwas
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest15.0 GB
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest3.2 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest12.8 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest23.7 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest24.3 GB
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest3.5 GB
YI
Yi 34b 200K AEZAKMI RAW 1701
Yi · RichardErkhov
Params34.4B
Context195K
Smallest12.8 GB
YI
Yi 34B 200K DARE megamerge v8
Yi · senseable
Params34.4B
Context195K
Smallest24.3 GB
YI
Yi 34b 200k Rawrr Dpo 2
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · forkjoin-ai
Params34.4B
Context8K
Q4_K_M20.7 GB