Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
OrionStar Yi 34B Chat
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Hyperion 3.0 Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
YI
Configurable-Yi-1.5-9B-Chat
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 1.5 9B
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Faro Yi 9B 200K
Yi · bartowski
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
Yi-34B-200K-RPMerge
Yi · backyardai
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Faro Yi 34B DPO
Yi · RichardErkhov
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
Nous Hermes 2 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 34B 200K DARE Merge v7
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi-1.5-6B-Chat
Yi · qwp4w3hyb
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · crusoeai
Params34.4B
Context8K
Q4_K_M20.7 GB
YI
01 Ai Yi 34B Chat
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
YI
models--mergekit-community--mergekit-passthrough-zpfenfn
Yi · MaziyarPanahi
Params23.2B
Context8K
Q4_K_M14.0 GB
YI
wenbopan Faro Yi 9B
Yi · RichardErkhov
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
Brucethemoose Yi 34B 200K DARE Megamerge v8
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
YI
Faro-Yi-9B-DPO
Yi · RichardErkhov
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
yi 34b
Yi · neopolita
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
TechxGenus CursorCore Yi 1.5B SR
Yi · RichardErkhov
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
mncai_yi-34b-v3
Yi · TheBloke
Params34.4B
Context8K
Q4_K_M20.7 GB
YI
Yi 34B 200k v2
Yi · MarsupialAI
Params34.4B
Context195K
Smallest14.6 GB
YI
Yi 34B 200K RPMerge
Yi · nold
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Tess 2.0 Yi 34B 200K
Yi · bartowski
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
CursorCore Yi 1.5B SR
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
CursorCore Yi 1.5B
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
Yi-1.5-34B-Chat-16K
Yi · gaianet
Params34.4B
Context16K
Q4_K_M20.7 GB
YI
Yi 1.5 9B Chat Abliterated
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 6B Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 1.5 9B Chat
Yi · tsunemoto
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Hyperion 3.0 Yi 34B
Yi · bartowski
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
01 Ai Yi 6B
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB