Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
Yi-1.5-9B
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-1.5-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Platypus Yi 34b
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Nous Hermes 2 Yi 34B
Yi · NousResearch
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-9B-Chat-16K
Yi · RichardErkhov
Params8.83B
Context16K
Q4_K_M5.3 GB
YI
Yi 34B Chat
Yi · second-state
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 1.5 9B Chat 16K Heretic
Yi · saidutta69
Params8.83B
Context16K
Q4_K_M5.3 GB
YI
Dolphin 2.9.1 Yi 1.5 34b Heretic
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
YI
bella bartender 9b yi
Yi · juiceb0xc0de
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 6b 200k
Yi · RichardErkhov
Params6.06B
Context195K
Q4_K_M3.7 GB
YI
Yi-1.5-9B-Chat
Yi · second-state
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 9B
Yi · MaziyarPanahi
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-34Bx2-MoE-60B
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
YI
CursorCore Yi 1.5B SR i1
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
CursorCore Yi 1.5B LC i1
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
YI
Yi-1.5-9B-Chat
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-1.5-6B-Chat
Yi · second-state
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · bartowski
Params34.4B
Context8K
Q4_K_M20.7 GB
YI
Yi-1.5-34B-Chat
Yi · bartowski
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
models--01-ai--Yi-1.5-9B-Chat
Yi · MaziyarPanahi
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-1.5-34B-Chat
Yi · lmstudio-community
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-1.5-9B-Chat
Yi · qwp4w3hyb
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
brucethemoose Yi 34B 200K DARE merge v7 iMat
Yi · Nexesenex
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
dragon yi 6b v0
Yi · llmware
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi-1.5-34B-Chat
Yi · second-state
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 34Bx2 MoE 60B
Yi · second-state
Params60.8B
Context195K
Q4_K_M36.7 GB
YI
Yi 34B 200K HESOYAM TURTLE 0208
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi-1.5-6B-Chat
Yi · lmstudio-community
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 34B
Yi · Artefact2
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · RichardErkhov
Params34.4B
Context8K
Q4_K_M20.7 GB