Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
Yi-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi-34B-Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
brucethemoose Yi 34B 200K DARE megamerge v8 iMat
Yi · Nexesenex
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Faro Yi 9B DPO
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
RpBird Yi 34B 200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Math-Yi-1.5-9B
Yi · mradermacher
Params8.83B
Context8K
Q4_K_M5.3 GB
GGUF
YI
CursorCore Yi 1.5B i1
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
YI
Yi-1.5-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
yi-1.5-6b-tofutune
Yi · mradermacher
Params6.06B
Context8K
Q4_K_M3.7 GB
GGUF
YI
Yi 34B GiftedConvo merged
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-34B-32K
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
Master-Yi-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 1.5 6B
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Med-Yi-1.5-9B
Yi · mradermacher
Params8.83B
Context8K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-6B
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi-9B-200K
Yi · mradermacher
Params8.83B
Context256K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-dolphin-9B
Yi · mradermacher
Params8.83B
Context8K
Q4_K_M5.3 GB
GGUF
YI
Yi 1.5 9B 32K
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Yi 34B Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-9B-32K
Yi · RichardErkhov
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-9B-Chat-16K
Yi · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
YI
Yi-6B-200K
Yi · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
YI
Yi 1.5 9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Dolphin 2.2 Yi 34B
Yi · second-state
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
YI
Faro Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
dolphin-2.2-yi-34b-200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF

Keep browsing