Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
Yi-1.5-9B-32K
Yi · NikolayKozloff
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
Yi 9B Petma Afk
Yi · fengpeisheng1
Params8.83B
Context4K
Smallest4.8 GB
YI
Yi 9B Petma afk Q5 K S
Yi · AIgotahole
Params8.83B
Context4K
Smallest6.1 GB
YI
Yi 34B 200K 20240307
Yi · AlenBadel
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
yi 34b 200k rawrr dpo 1
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
YI
Yi 9B Petma Afk
Yi · fengpeisheng1
Params8.83B
Context4K
Smallest5.0 GB
YI
Yi-1.5-9B-Chat
Yi · YorkieOH10
Params8.83B
Context4K
Smallest9.4 GB
YI
Yi-1.5-9B-Chat-16K
Yi · e2jhiubyiiyvw
Params8.83B
Context16K
Smallest6.3 GB
YI
Bhenrym14 Platypus Yi 34b
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
YI
Platypus Yi 34b
Yi · RichardErkhov
Params34B
Context4K
Q4_K_M20.7 GB
YI
RpBird Yi 34B 200k quant
Yi · SkySyrup
Params34.4B
Context195K
Smallest24.3 GB
YI
Yi 1.5 9B Chat 16K Q2 K
Yi · leafspark
Params8.83B
Context16K
Smallest3.4 GB
YI
Yi 1.5 6B Chat
Yi · ijohn07
Params6.06B
Context4K
Smallest6.4 GB
YI
Hyeogi Yi 6b Dpo v0.1
Yi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest36.5 GB
YI
Yi 6B Infinity Chat
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
YI
Yi-1.5-9B-Chat-16K
Yi · NikolayKozloff
Params8.83B
Context16K
Smallest9.4 GB
YI
Hercules 4.0 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
YI
Yi 6b 200k
Yi · tensorblock
Params6.06B
Context195K
Smallest2.3 GB
YI
Yi-1.5-9B-Chat
Yi · fenglingzmb
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-1.5-34B
Yi · YorkieOH10
Params34.4B
Context4K
Smallest36.5 GB
YI
Master-Yi-9B
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
01 ai Yi 34B 200K
Yi · RichardErkhov
Params34.4B
Context195K
Smallest12.8 GB
YI
Yi 9B Petma Afk
Yi · fengpeisheng1
Params8.83B
Context4K
Smallest6.3 GB
YI
Yi-1.5-9B-32K
Yi · NikolayKozloff
Params8.83B
Context32K
Smallest7.2 GB
YI
Yi-1.5-34B-Chat-16K
Yi · zsolx2
Params34.4B
Context16K
Smallest19.5 GB
YI
Yi 1.5 Therapod SFT
Yi · Lumiiree
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 1.5 9B Chat 16K Q3 K S
Yi · leafspark
Params8.83B
Context16K
Smallest3.9 GB
YI
yi 6b
Yi · Inza124
Params6.06B
Context4K
Smallest3.5 GB
YI
Yi-1.5-9B-Chat
Yi · IncreasingLoss
Params8.83B
Context4K
Smallest7.2 GB