Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
Yi 34Bx2 MOE 200K
Yi · cloudyu
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest7.2 GB
GGUF
YI
Edgerunners_yi-9b-may-ortho-baukit-30fail-3000total-bf16
Yi · lucyknada
Params8.83B
Context4K
Smallest4.3 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · ZeroWw
Params6.06B
Context4K
Smallest5.0 GB
GGUF
YI
01 Ai Yi 1.5 9B 32K
Yi · tensorblock
Params8.83B
Context32K
Smallest3.4 GB
GGUF
YI
01 Ai Yi 1.5 34B
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · leafspark
Params34.4B
Context16K
Smallest28.2 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest28.2 GB
GGUF
YI
Yi 1.5 6B Chat
Yi · itlwas
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · ByteBrew23
Params8.83B
Context4K
Smallest6.3 GB
GGUF
YI
qw yi 9b
Yi · paul-stansifer
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 1.5 34B Chat bpw4.4 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
01 Ai Yi 1.5 9B
Yi · tensorblock
Params8.83B
Context4K
Smallest3.4 GB
GGUF
YI
Yi-6B-200K
Yi · Angel367
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
YI
Yi 1.5 34B Chat bpw4.8 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 9B Chat 16K Q5 K M
Yi · leafspark
Params8.83B
Context16K
Smallest6.3 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · leafspark
Params34.4B
Context16K
Smallest12.8 GB
GGUF
YI
Yi 1.5 9B Chat
Yi · itlwas
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
EVA Yi 1.5 9B 32K V1 Q8 0
Yi · Nothing448
Params8.83B
Context32K
Smallest9.4 GB
GGUF
YI
Yi 1.5 34B Chat
Yi · itlwas
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest15.0 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest3.2 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest12.8 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest23.7 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest24.3 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest3.5 GB
GGUF
YI
Yi 34b 200K AEZAKMI RAW 1701
Yi · RichardErkhov
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
Yi 34B 200K DARE megamerge v8
Yi · senseable
Params34.4B
Context195K
Smallest24.3 GB
GGUF
YI
Yi 34b 200k Rawrr Dpo 2
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-34b
Yi · forkjoin-ai
Params34.4B
Context8K
Q4_K_M20.7 GB
GGUF

Keep browsing