Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
OrionStar Yi 34B Chat
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Hyperion 3.0 Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
Coding
YI
Configurable-Yi-1.5-9B-Chat
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 1.5 9B
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Faro Yi 9B 200K
Yi · bartowski
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Yi-34B-200K-RPMerge
Yi · backyardai
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Faro Yi 34B DPO
Yi · RichardErkhov
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
Nous Hermes 2 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
YI
Yi 34B 200K DARE Merge v7
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · qwp4w3hyb
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-34b
Yi · crusoeai
Params34.4B
Context8K
Q4_K_M20.7 GB
GGUF
YI
01 Ai Yi 34B Chat
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
YI
models--mergekit-community--mergekit-passthrough-zpfenfn
Yi · MaziyarPanahi
Params23.2B
Context8K
Q4_K_M14.0 GB
GGUF
YI
wenbopan Faro Yi 9B
Yi · RichardErkhov
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Brucethemoose Yi 34B 200K DARE Megamerge v8
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
Faro-Yi-9B-DPO
Yi · RichardErkhov
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
yi 34b
Yi · neopolita
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
TechxGenus CursorCore Yi 1.5B SR
Yi · RichardErkhov
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
YI
mncai_yi-34b-v3
Yi · TheBloke
Params34.4B
Context8K
Q4_K_M20.7 GB
GGUF
YI
Yi 34B 200k v2
Yi · MarsupialAI
Params34.4B
Context195K
Smallest14.6 GB
GGUF
YI
Yi 34B 200K RPMerge
Yi · nold
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Tess 2.0 Yi 34B 200K
Yi · bartowski
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
CursorCore Yi 1.5B SR
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
YI
CursorCore Yi 1.5B
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
YI
Yi-1.5-34B-Chat-16K
Yi · gaianet
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 9B Chat Abliterated
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 6B Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 1.5 9B Chat
Yi · tsunemoto
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Hyperion 3.0 Yi 34B
Yi · bartowski
Params34.4B
Context4K
Q4_K_M20.7 GB
Coding
YI
01 Ai Yi 6B
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF

Keep browsing