Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
Nous Hermes 2 Yi 34B Q4 K M
Yi · itlwas
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
YI
Yi-1.5-34B-Chat-16K
Yi · leafspark
Params34.4B
Context16K
Smallest19.6 GB
GGUF
YI
yi-1.5-6b-tofutune-gguf
Yi · simonbutt
Params6.06B
Context8K
Q4_K_M3.7 GB
GGUF
YI
Faro Yi 14B Merge
Yi · DisOOM
Params14B
Context32K
Smallest9.7 GB
GGUF
YI
Yi 1.5 9B Chat Abliterated
Yi · byroneverson
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
yi 9b 200k
Yi · neopolita
Params8.83B
Context256K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-9B-32K
Yi · ZeroWw
Params8.83B
Context32K
Smallest6.9 GB
GGUF
YI
Brucethemoose CaPlatTessDolXaBoros Yi 34B 200K DARE Ties
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
Yi 1.5 6B RYS 20 23
Yi · john-broadway
Params6.58B
Context4K
Q4_K_M4.0 GB
Reasoning
YI
Hyperion 2.0 Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest6.4 GB
GGUF
YI
Yi 1.5 9B Chat 16K Abliterated
Yi · byroneverson
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest2.3 GB
GGUF
YI
Yi 1.5 9B Chat 16K Q5 K S
Yi · leafspark
Params8.83B
Context16K
Smallest6.1 GB
GGUF
YI
Fook Yi 34B 32K v1
Yi · BeaverLegacy
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest5.0 GB
GGUF
YI
yi 34b chat
Yi · neopolita
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Brucethemoose CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest3.5 GB
GGUF
YI
Yi 1.5 9B Chat 16K Q6 K
Yi · leafspark
Params8.83B
Context16K
Smallest7.2 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · leafspark
Params34.4B
Context16K
Smallest24.3 GB
GGUF
YI
Yi 1.5 9B Chat 16K Q3 K M
Yi · leafspark
Params8.83B
Context16K
Smallest4.3 GB
GGUF
YI
asm2asm yi 1.5b 500k 2ep x86 arm gnueabi gcc
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
GGUF
YI
Yi 1.5 9B
Yi · denkijin
Params8.83B
Context12K
Smallest9.4 GB
CodingTool use
YI
dao 9b Q8 0
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest9.4 GB
GGUF
YI
01 Ai Yi 1.5 34B 32K
Yi · tensorblock
Params34.4B
Context32K
Smallest12.8 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-34b
Yi · YorkieOH10
Params34.4B
Context8K
Smallest36.5 GB
CodingTool use
YI
Yi 9Bx2 MOE i1
Yi · mradermacher
Params15.3B
Context4K
Q4_K_M9.3 GB
GGUF
YI
Yi 6B yoruno
Yi · nenekochan
Params6.06B
Context4K
Smallest4.3 GB
GGUF
YI
Yi 1.5 9B
Yi · denkijin
Params8.83B
Context12K
Q4_K_M5.3 GB
CodingTool use

Keep browsing