Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
Nous Hermes 2 Yi 34B Q4 K M
Yi · itlwas
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-34B-Chat-16K
Yi · leafspark
Params34.4B
Context16K
Smallest19.6 GB
YI
yi-1.5-6b-tofutune-gguf
Yi · simonbutt
Params6.06B
Context8K
Q4_K_M3.7 GB
YI
Faro Yi 14B Merge
Yi · DisOOM
Params14B
Context32K
Smallest9.7 GB
YI
Yi 1.5 9B Chat Abliterated
Yi · byroneverson
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
yi 9b 200k
Yi · neopolita
Params8.83B
Context256K
Q4_K_M5.3 GB
YI
Yi-1.5-9B-32K
Yi · ZeroWw
Params8.83B
Context32K
Smallest6.9 GB
YI
Brucethemoose CaPlatTessDolXaBoros Yi 34B 200K DARE Ties
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
YI
Yi 1.5 6B RYS 20 23
Yi · john-broadway
Params6.58B
Context4K
Q4_K_M4.0 GB
YI
Hyperion 2.0 Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest6.4 GB
YI
Yi 1.5 9B Chat 16K Abliterated
Yi · byroneverson
Params8.83B
Context16K
Q4_K_M5.3 GB
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest2.3 GB
YI
Yi 1.5 9B Chat 16K Q5 K S
Yi · leafspark
Params8.83B
Context16K
Smallest6.1 GB
YI
Fook Yi 34B 32K v1
Yi · BeaverLegacy
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest5.0 GB
YI
yi 34b chat
Yi · neopolita
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Brucethemoose CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest3.5 GB
YI
Yi 1.5 9B Chat 16K Q6 K
Yi · leafspark
Params8.83B
Context16K
Smallest7.2 GB
YI
Yi-1.5-34B-Chat-16K
Yi · leafspark
Params34.4B
Context16K
Smallest24.3 GB
YI
Yi 1.5 9B Chat 16K Q3 K M
Yi · leafspark
Params8.83B
Context16K
Smallest4.3 GB
YI
asm2asm yi 1.5b 500k 2ep x86 arm gnueabi gcc
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
Yi 1.5 9B
Yi · denkijin
Params8.83B
Context12K
Smallest9.4 GB
YI
dao 9b Q8 0
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest9.4 GB
YI
01 Ai Yi 1.5 34B 32K
Yi · tensorblock
Params34.4B
Context32K
Smallest12.8 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · YorkieOH10
Params34.4B
Context8K
Smallest36.5 GB
YI
Yi 9Bx2 MOE i1
Yi · mradermacher
Params15.3B
Context4K
Q4_K_M9.3 GB
YI
Yi 6B yoruno
Yi · nenekochan
Params6.06B
Context4K
Smallest4.3 GB
YI
Yi 1.5 9B
Yi · denkijin
Params8.83B
Context12K
Q4_K_M5.3 GB