Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
openbuddy-yi-34b-v21.5-32k-agent
Yi · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
YI
models--01-ai--Yi-1.5-34B-Chat
Yi · MaziyarPanahi
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · duolaf
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 34B 200K DARE Merge v5
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties ExtremeDensity
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Nous Hermes 2 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 34B 200K HESOYAM TURTLE 0208 i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · afrideva
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Master-Yi-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · gaianet
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Faro-Yi-9B-DPO
Yi · bartowski
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-9B-Chat-16K
Yi · second-state
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
YI
01 Ai Yi 34B
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
YI
Samantha Yi 34b
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
YI
Yi 6B 200K
Yi · MaziyarPanahi
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
YI
Mahou-1.2-yi-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
NobodyExistsOnTheInternet Yi 34B GiftedConvo merged
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-9B-Chat-16K
Yi · qwp4w3hyb
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
YI
Yi 1.5 9B Chat
Yi · RichardErkhov
Params8.83B
Context8K
Q4_K_M5.3 GB
GGUF
YI
Yi 6B 200K
Yi · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
YI
Instruct Yi 6B Dolly CodeAlpaca
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF
YI
Faro Yi 9B 200k
Yi · DisOOM
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
hongzoh Yi 6B Open Platypus v2
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi-1.5-9B-Chat-16K-Q4_0.gguf
Yi · GPT4All-Community
Params8.83B
Context16K
Smallest5.0 GB
GGUF
YI
Yi 34B 200K DARE Merge v7
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 9B Chat GGUF v2
Yi · QuantFactory
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Faro Yi 9B
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
NousResearch Nous Hermes 2 Yi 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
YI
Nous Hermes 2 Yi 34B
Yi · tsunemoto
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use

Keep browsing