Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
Yi-1.5-9B-32K
Yi · NikolayKozloff
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Yi 9B Petma Afk
Yi · fengpeisheng1
Params8.83B
Context4K
Smallest4.8 GB
Roleplay
YI
Yi 9B Petma afk Q5 K S
Yi · AIgotahole
Params8.83B
Context4K
Smallest6.1 GB
GGUF
YI
Yi 34B 200K 20240307
Yi · AlenBadel
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
yi 34b 200k rawrr dpo 1
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
Yi 9B Petma Afk
Yi · fengpeisheng1
Params8.83B
Context4K
Smallest5.0 GB
Roleplay
YI
Yi-1.5-9B-Chat
Yi · YorkieOH10
Params8.83B
Context4K
Smallest9.4 GB
GGUF
YI
Yi-1.5-9B-Chat-16K
Yi · e2jhiubyiiyvw
Params8.83B
Context16K
Smallest6.3 GB
GGUF
YI
Bhenrym14 Platypus Yi 34b
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
YI
Platypus Yi 34b
Yi · RichardErkhov
Params34B
Context4K
Q4_K_M20.7 GB
GGUF
YI
RpBird Yi 34B 200k quant
Yi · SkySyrup
Params34.4B
Context195K
Smallest24.3 GB
GGUF
YI
Yi 1.5 9B Chat 16K Q2 K
Yi · leafspark
Params8.83B
Context16K
Smallest3.4 GB
GGUF
YI
Yi 1.5 6B Chat
Yi · ijohn07
Params6.06B
Context4K
Smallest6.4 GB
GGUF
YI
Hyeogi Yi 6b Dpo v0.1
Yi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest36.5 GB
GGUF
YI
Yi 6B Infinity Chat
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF
YI
Yi-1.5-9B-Chat-16K
Yi · NikolayKozloff
Params8.83B
Context16K
Smallest9.4 GB
GGUF
YI
Hercules 4.0 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
GGUF
YI
Yi 6b 200k
Yi · tensorblock
Params6.06B
Context195K
Smallest2.3 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · fenglingzmb
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-34B
Yi · YorkieOH10
Params34.4B
Context4K
Smallest36.5 GB
GGUF
YI
Master-Yi-9B
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
01 ai Yi 34B 200K
Yi · RichardErkhov
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
Yi 9B Petma Afk
Yi · fengpeisheng1
Params8.83B
Context4K
Smallest6.3 GB
Roleplay
YI
Yi-1.5-9B-32K
Yi · NikolayKozloff
Params8.83B
Context32K
Smallest7.2 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · zsolx2
Params34.4B
Context16K
Smallest19.5 GB
GGUF
YI
Yi 1.5 Therapod SFT
Yi · Lumiiree
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 1.5 9B Chat 16K Q3 K S
Yi · leafspark
Params8.83B
Context16K
Smallest3.9 GB
GGUF
YI
yi 6b
Yi · Inza124
Params6.06B
Context4K
Smallest3.5 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · IncreasingLoss
Params8.83B
Context4K
Smallest7.2 GB
GGUF

Keep browsing