Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
Yi-34Bx2-MoE-60B-DPO
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
YI
Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-6B-200K
Yi · duyntnet
Params6.06B
Context195K
Q4_K_M3.7 GB
YI
blossom v3 1 yi 34b i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
RpBird Yi 34B 200k i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
YI
Yi-34B-200K-AEZAKMI-v2
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi-1.5-9B-32K
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
SG Raccoon Yi 55B
Yi · TheBloke
Params55.6B
Context4K
Q4_K_M33.3 GB
YI
taozi555_rpbird-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi-9B-Coder
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 1.5 6B Chat
Yi · QuantFactory
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
YI
Yi-9B-200K
Yi · mradermacher
Params8.83B
Context256K
Q4_K_M5.3 GB
YI
EVA Yi 1.5 9B 32K V1
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi-1.5-6B
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 1.5 9B Chat Abliterated
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-34B-200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
dolphin-2.9.1-yi-1.5-9b
Yi · mradermacher
Params8.83B
Context12K
Q4_K_M5.3 GB
YI
Yi-1.5-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
dolphin-2.9.1-yi-1.5-9b
Yi · mradermacher
Params8.83B
Context12K
Q4_K_M5.3 GB
YI
Mahou-1.3-yi-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
dragon yi 6B v0
Yi · TheBloke
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
brucethemoose_yi-34b-200k-dare-merge-v5
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Nous-Hermes-2-Yi-34B
Yi · duyntnet
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-9B-coder
Yi · mradermacher
Params8.83B
Context8K
Q4_K_M5.3 GB
YI
SG Raccoon Yi 55B 200k i1
Yi · mradermacher
Params55.6B
Context195K
Q4_K_M33.3 GB
YI
Yi-1.5-34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Hyperion 3.0 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB