Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
Yi 6B Infinity Chat i1
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · gaianet
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 34b 200k Rawrr Dpo 2
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
01 Ai Yi 6B 200K
Yi · tensorblock
Params6.06B
Context195K
Smallest2.3 GB
GGUF
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties ExtremeDensity
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Blossom v4 Yi 34b
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
yi 1.5 6b
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 1.5 6B Chat
Yi · Felladrin
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Samantha Yi 34b
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
YI
Yi 34B 200K
Yi · nold
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · qwp4w3hyb
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
01 Ai Yi 1.5 6B Chat
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF
YI
Locutusque Hyperion 2.0 Yi 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Gaston_Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context8K
Q4_K_M5.3 GB
GGUF
YI
Yi-34B-200K-XLCTX-RAW-ORPO-0805-GaLore
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties ExtremeDensity
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 6B Open Platypus v2 i1
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Notaires_Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context8K
Q4_K_M5.3 GB
GGUF
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Faro Yi 34B 200K iMatrix
Yi · MarsupialAI
Params34.4B
Context195K
Smallest9.3 GB
GGUF
YI
Fook-Yi-34B-32K-v1
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
Hyeogi Yi 9b v1
Yi · tensorblock
Params8.95B
Context2K
Smallest3.4 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · larenspear
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Capybara Tess Yi 34B 200K DARE Ties
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
dragon yi 1.5v 9b
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 34B 200K DARE Merge v5
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 6B Chat Math
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 34B 200K RPMerge iMat
Yi · brucethemoose
Params34.4B
Context195K
Smallest10.3 GB
GGUF
YI
Yi 1.5 34B 32K Rebased 1406
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
samantha yi 34b
Yi · filipealmeida
Params34.4B
Context16K
Smallest19.5 GB
GGUF

Keep browsing