Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
openbuddy-yi-34b-v21.5-32k-agent
Yi · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
YI
models--01-ai--Yi-1.5-34B-Chat
Yi · MaziyarPanahi
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-9B-Chat
Yi · duolaf
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 34B 200K DARE Merge v5
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties ExtremeDensity
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Nous Hermes 2 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 34B 200K HESOYAM TURTLE 0208 i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi-1.5-6B-Chat
Yi · afrideva
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Master-Yi-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-1.5-9B-Chat
Yi · gaianet
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Faro-Yi-9B-DPO
Yi · bartowski
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
Yi-1.5-9B-Chat-16K
Yi · second-state
Params8.83B
Context16K
Q4_K_M5.3 GB
YI
01 Ai Yi 34B
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
YI
Samantha Yi 34b
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
YI
Yi 6B 200K
Yi · MaziyarPanahi
Params6.06B
Context195K
Q4_K_M3.7 GB
YI
Mahou-1.2-yi-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
NobodyExistsOnTheInternet Yi 34B GiftedConvo merged
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-9B-Chat-16K
Yi · qwp4w3hyb
Params8.83B
Context16K
Q4_K_M5.3 GB
YI
Yi 1.5 9B Chat
Yi · RichardErkhov
Params8.83B
Context8K
Q4_K_M5.3 GB
YI
Yi 6B 200K
Yi · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB
YI
Instruct Yi 6B Dolly CodeAlpaca
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
YI
Faro Yi 9B 200k
Yi · DisOOM
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
hongzoh Yi 6B Open Platypus v2
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi-1.5-9B-Chat-16K-Q4_0.gguf
Yi · GPT4All-Community
Params8.83B
Context16K
Smallest5.0 GB
YI
Yi 34B 200K DARE Merge v7
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 1.5 9B Chat GGUF v2
Yi · QuantFactory
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Faro Yi 9B
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
NousResearch Nous Hermes 2 Yi 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Nous Hermes 2 Yi 34B
Yi · tsunemoto
Params34.4B
Context4K
Q4_K_M20.7 GB