Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
yi 6b chat
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 9B 200K iMatrix
Yi · MarsupialAI
Params8.83B
Context256K
Smallest2.5 GB
YI
Yi 1.5 34B Chat Abliterated
Yi · byroneverson
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-6B-Chat
Yi · Felladrin
Params6.06B
Context4K
Smallest3.2 GB
YI
Adamo1139 Yi 34B 200K AEZAKMI v2
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
YI
Faro-Yi-9B-DPO
Yi · vikarti-anatra
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
Yi 6B Open Platypus v2
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
yi 6b
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Azure99 Blossom V3_1 Yi 34b
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
YI
Yi 1.5 6B
Yi · echos-keeper
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 9b Rp
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Brucethemoose Yi 34B 200K DARE Merge v5
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
YI
yi 9b
Yi · neopolita
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 6B GGUF fp16
Yi · ddh0
Params6.06B
Context32K
Smallest12.1 GB
YI
Yi-1.5-9B-Chat
Yi · vsevolodl
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
agronomYi hermes 34B
Yi · gbstox
Params34.4B
Context4K
Smallest24.3 GB
YI
ChatAllInOne Yi 34B 200K V1
Yi · DrNicefellow
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 1.5 9B
Yi · paul-stansifer
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-1.5-9B-Chat-16K
Yi · leafspark
Params8.83B
Context16K
Q4_K_M5.3 GB
YI
brucethemoose Yi 34b Capybara 200K Fixed Temp iMat
Yi · Nexesenex
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 1.5 34B
Yi · itlwas
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
dragon yi 9b
Yi · llmware
Params8.83B
Context4K
Smallest5.3 GB
YI
Azure99 Blossom v4 Yi 34b
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest4.2 GB
YI
Brucethemoose Yi 34B 200K DARE Merge v7
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest3.0 GB
YI
Master-Yi-9B
Yi · LoneStriker
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-1.5-6B-Chat
Yi · YorkieOH10
Params6.06B
Context4K
Smallest6.4 GB
YI
Yi 6B Chat
Yi · SinpxAI
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 1.5 34B Chat bpw3.7 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB