Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
Yi-1.5-34B-Chat
Yi · vsevolodl
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
TechxGenus CursorCore Yi 1.5B LC
Yi · RichardErkhov
Params1.48B
Context128K
Q4_K_M1.0 GB
GGUF
YI
TechxGenus Yi 9B Coder
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
Coding
YI
Yi-9b-v1
Yi · RichardErkhov
Params8.95B
Context2K
Q4_K_M5.4 GB
GGUF
YI
Tess 2.0 Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 6B Chat
Yi · second-state
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Wenbopan Faro Yi 9B DPO
Yi · tensorblock
Params8.83B
Context32K
Smallest3.4 GB
GGUF
YI
Walmart the bag Yi 6B Infinity Chat
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Fook-Yi-34B-32K-v1a
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · MoMonir
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 1.5 9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Master-Yi-9B
Yi · qnguyen3
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 6b Dpo v0.4
Yi · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
YI
yi 34b 200k
Yi · neopolita
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
yi 1.5 6b chat
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Med-Yi-1.5-9B
Yi · RichardErkhov
Params8.83B
Context8K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-dolphin-9B
Yi · RichardErkhov
Params8.83B
Context8K
Q4_K_M5.3 GB
GGUF
YI
Yi 6B yoruno
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Fook-Yi-34B-32K-25p-Chat
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
Yi 34b 200K alpaca rpv3 scipy
Yi · zgce
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 34B 200K RPMerge
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Tess 2.0 Yi 34B 200K
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 6B 200K
Yi · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
YI
Yi 9B 200K
Yi · bartowski
Params8.83B
Context256K
Q4_K_M5.3 GB
GGUF
YI
Yi 6b Dpo v0.1
Yi · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
YI
Yi 1.5 9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 34b Chat Spicyboros limarpv3
Yi · zgce
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
YI-7B-Nicky1
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-34b
Yi · LoneStriker
Params34.4B
Context8K
Q4_K_M20.7 GB
CodingTool use
YI
ahmedheakl asm2asm yi 1.5b 100k float16 attn
Yi · RichardErkhov
Params1.48B
Context128K
Q4_K_M1.0 GB
GGUF

Keep browsing