Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
Yi 9B Petma Afk
Yi · fengpeisheng1
Params8.83B
Context4K
Q4_K_M5.3 GB
Roleplay
YI
Yi 1.5 9B Chat 16K
Yi · wencan-lab
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
YI
Hyeogi Yi 6b Dpo v0.2
Yi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
YI
Yi 9B Petma Afk
Yi · fengpeisheng1
Params8.83B
Context4K
Smallest6.1 GB
Roleplay
YI
Yi 9Bx2 MOE
Yi · mradermacher
Params15.3B
Context4K
Q4_K_M9.3 GB
GGUF
YI
Yi-1.5-9B-32K
Yi · redponike
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Yi 1.5 9B Chat
Yi · Aldaris
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Hyeogi Yi 6b Dpo v0.3
Yi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · NikolayKozloff
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Master-Yi-9B
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest5.0 GB
GGUF
YI
EVA Yi 1.5 9B 32K V1 Q4 K M
Yi · itlwas
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Yi 1.5 9B
Yi · itlwas
Params8.83B
Context12K
Q4_K_M5.3 GB
CodingTool use
YI
dolphin-2.9.1-yi-1.5-9b
Yi · ctrlshiftm
Params8.83B
Context12K
Smallest7.2 GB
CodingTool use
YI
01 Ai Yi 1.5 6B
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest19.5 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · ukung
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Cgato Thespis Yi 34b DPO v0.7 iMat
Yi · Nexesenex
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · exocet25
Params8.83B
Context4K
Smallest9.4 GB
GGUF
YI
Yi-9B-200K-AEZAKMI-RAW-TOXIC-1
Yi · TouchNight
Params8.83B
Context256K
Smallest7.2 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · kowlick
Params34.4B
Context4K
Smallest36.5 GB
GGUF
YI
Yi-1.5-9B-32K
Yi · NikolayKozloff
Params8.83B
Context32K
Smallest9.4 GB
GGUF
YI
asm2asm yi 1.5b 100k float16 attn
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · NikolayKozloff
Params6.06B
Context4K
Smallest5.0 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · iSomer
Params8.83B
Context4K
Smallest9.4 GB
GGUF
YI
Master Yi 9B
Yi · tensorblock
Params8.83B
Context4K
Smallest3.4 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · leafspark
Params34.4B
Context16K
Smallest36.5 GB
GGUF
YI
Capybara Tess Yi 34B 200K
Yi · RichardErkhov
Params34B
Context195K
Smallest12.8 GB
GGUF
YI
Chinoll Yi 6b 200k Dpo
Yi · tensorblock
Params6.06B
Context195K
Smallest2.3 GB
GGUF
YI
Yi 6b Dpo v0.3
Yi · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · leafspark
Params34.4B
Context16K
Smallest16.7 GB
GGUF

Keep browsing