Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
dolphin-2.9.1-yi-1.5-9b
Yi · bartowski
Params8.83B
Context12K
Q4_K_M5.3 GB
YI
Yi 34B 200K XLCTX
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Platypus Yi 34b
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-34B-Chat-16K
Yi · second-state
Params34.4B
Context16K
Q4_K_M20.7 GB
YI
Yi-1.5-6B-Chat
Yi · gaianet
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 34B Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
adamo1139_yi-34b-200k-aezakmi-v2
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
abacusai Smaug Yi 34B v0.1 iMat
Yi · Nexesenex
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 1.5 34B Chat
Yi · tsunemoto
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-9B-Chat-16K
Yi · gaianet
Params8.83B
Context16K
Q4_K_M5.3 GB
YI
dolphin-2.9.1-yi-1.5-9b
Yi · RichardErkhov
Params8.83B
Context12K
Q4_K_M5.3 GB
YI
Notaires_dolphin-2.9.1-yi-1.5-9b
Yi · mradermacher
Params8.83B
Context12K
Q4_K_M5.3 GB
YI
Yi 1.5 9B
Yi · QuantFactory
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
dragon yi 1.5v 9b i1
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
HenryJJ Instruct Yi 6B Dolly CodeAlpaca
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 9B Coder
Yi · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 6b Dpo v0.2
Yi · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
YI
Faro Yi 34B
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
yi 34b 200k rawrr dpo 1 i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 9B 200K
Yi · MaziyarPanahi
Params8.83B
Context256K
Q4_K_M5.3 GB
YI
HenryJJ Instruct Yi 6B Dolly15K
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Nous Hermes 2 Yi 34B iMat
Yi · qwp4w3hyb
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 9B
Yi · TouchNight
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-1.5-34B-Chat-16K
Yi · bartowski
Params34.4B
Context16K
Q4_K_M20.7 GB
YI
Blossom v4 Yi 34b
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 34B 200K RPMerge
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 34b 200k Aezakmi Raw Toxic 2702
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
platypus yi 34b
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Faro Yi 9B DPO
Yi · duyntnet
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
Gaston_dolphin-2.9.1-yi-1.5-9b
Yi · mradermacher
Params8.83B
Context12K
Q4_K_M5.3 GB