Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
Fook-Yi-34B-v1a
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 34B Chat bpw5.5 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 9B Chat MBLC
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 1.5 34B Chat bpw4 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Brucethemoose Capybara Tess Yi 34B 200K
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
lumynax chat yi 15 34b
Yi · AbteeXAILab
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 34b 200K AEZAKMI RAW 1701
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
Yi-1.5-34B-32K
Yi · LoneStriker
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
Yi 34B 200K DARE Merge v5
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
TechxGenus CursorCore Yi 1.5B
Yi · RichardErkhov
Params1.48B
Context128K
Q4_K_M1.0 GB
GGUF
YI
blossom v3 1 yi 34b
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 34B Chat bpw3 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
bhenrym14 airoboros 3 1 yi 34b 200k iMat
Yi · Nexesenex
Params34.4B
Context195K
Smallest9.3 GB
GGUF
YI
Abhishekchohan Yi 9B Forest DPO v1.0
Yi · tensorblock
Params8.83B
Context4K
Smallest3.4 GB
GGUF
YI
Instruct Yi 6B Dolly15K
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF
YI
Mermaid Yi 9B Factual Temps Full Synthetic
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 1.5 9B Chat
Yi · Kondara
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-34B-200K-XLCTX-RAW-ORPO-0805-GaLore
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · macadeliccc
Params34.4B
Context32K
Q4_K_M20.7 GB
CodingTool use
YI
Hyeogi Yi 6b Dpo v0.4
Yi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
YI
Yi-1.5-6B
Yi · afrideva
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Nous Hermes 2 Yi 34B
Yi · gguf
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
YI
01 ai Yi 9B
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 6B 200k
Yi · SinpxAI
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
YI
Yi 6B Infinity Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
yi 6b 200k
Yi · neopolita
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
YI
Nous Hermes 2 Yi 34B IQ3 imatrix
Yi · patf82
Params34.4B
Context4K
Smallest15.0 GB
Tool use
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · NikolayKozloff
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Hyperion 3.0 Yi 34B
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
Coding

Keep browsing