Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
Yi-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi-34B-Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
brucethemoose Yi 34B 200K DARE megamerge v8 iMat
Yi · Nexesenex
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Faro Yi 9B DPO
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
RpBird Yi 34B 200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Math-Yi-1.5-9B
Yi · mradermacher
Params8.83B
Context8K
Q4_K_M5.3 GB
YI
CursorCore Yi 1.5B i1
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
Yi-1.5-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
yi-1.5-6b-tofutune
Yi · mradermacher
Params6.06B
Context8K
Q4_K_M3.7 GB
YI
Yi 34B GiftedConvo merged
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-1.5-34B-Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-34B-32K
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
Master-Yi-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 1.5 6B
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Med-Yi-1.5-9B
Yi · mradermacher
Params8.83B
Context8K
Q4_K_M5.3 GB
YI
Yi-1.5-6B
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi-9B-200K
Yi · mradermacher
Params8.83B
Context256K
Q4_K_M5.3 GB
YI
Yi-1.5-dolphin-9B
Yi · mradermacher
Params8.83B
Context8K
Q4_K_M5.3 GB
YI
Yi 1.5 9B 32K
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
Yi 34B Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-9B-32K
Yi · RichardErkhov
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
Yi-1.5-9B-Chat-16K
Yi · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
YI
Yi-6B-200K
Yi · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB
YI
Yi 1.5 9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Dolphin 2.2 Yi 34B
Yi · second-state
Params34.4B
Context16K
Q4_K_M20.7 GB
YI
Faro Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
dolphin-2.2-yi-34b-200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB