Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
Yi 1.5 34B Chat bpw5 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-34B-Chat
Yi · YorkieOH10
Params34.4B
Context4K
Smallest36.5 GB
YI
Yi 34B 200K
Yi · second-state
Params34.4B
Context195K
Smallest12.8 GB
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest4.2 GB
YI
Yi-1.5-9B-Chat-16K
Yi · leafspark
Params8.83B
Context16K
Smallest5.1 GB
YI
Yi 1.5 6B
Yi · itlwas
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 1.5 34B 32K Magpie Ultra 0611
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
SanjiWatsuki SUS Wizard Yi 34B iMat
Yi · Nexesenex
Params34.4B
Context8K
Q4_K_M20.7 GB
YI
Cgato Thespis Yi 34b v0.7 iMat
Yi · Nexesenex
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi-1.5-6B
Yi · NikolayKozloff
Params6.06B
Context4K
Smallest6.4 GB
YI
Yi 1.5 9B Chat
Yi · SandLogicTechnologies
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 6b v0.3
Yi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest18.1 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest16.7 GB
YI
Yi 6B 200K GGUF fp16
Yi · ddh0
Params6.06B
Context195K
Smallest12.1 GB
YI
Yi 6B
Yi · SinpxAI
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi-1.5-9B-Chat
Yi · MoMonir
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 9B Petma Afk
Yi · fengpeisheng1
Params8.83B
Context4K
Smallest7.2 GB
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest2.7 GB
YI
Brucethemoose CaPlatTessDolXaBoros Yi 34B 200K DARE Ties ExtremeDensity
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
YI
Nous Hermes 2 Yi 34B
Yi · travior
Params34.4B
Context4K
Smallest19.5 GB
YI
Yi 1.5 34B Chat bpw4.2 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
yi 1.5 9b
Yi · neopolita
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 1.5 9B
Yi · wencan-lab
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 1.5 9B
Yi · itlwas
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest4.3 GB
YI
Yi 9K 200K AEZKAMI RAW TOXIC
Yi · adamo1139
Params8.83B
Context256K
Smallest5.0 GB
YI
asm2asm yi 1.5b 100k x86 arm gnueabi gcc
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
Yi-1.5-9B
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest9.4 GB
YI
Yi-1.5-34B-Chat-16K
Yi · leafspark
Params34.4B
Context16K
Q4_K_M20.7 GB