Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
yi 6b chat
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 9B 200K iMatrix
Yi · MarsupialAI
Params8.83B
Context256K
Smallest2.5 GB
GGUF
YI
Yi 1.5 34B Chat Abliterated
Yi · byroneverson
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · Felladrin
Params6.06B
Context4K
Smallest3.2 GB
GGUF
YI
Adamo1139 Yi 34B 200K AEZAKMI v2
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
Faro-Yi-9B-DPO
Yi · vikarti-anatra
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Yi 6B Open Platypus v2
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
yi 6b
Yi · neopolita
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Azure99 Blossom V3_1 Yi 34b
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
YI
Yi 1.5 6B
Yi · echos-keeper
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 9b Rp
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
Roleplay
YI
Brucethemoose Yi 34B 200K DARE Merge v5
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
yi 9b
Yi · neopolita
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 6B GGUF fp16
Yi · ddh0
Params6.06B
Context32K
Smallest12.1 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · vsevolodl
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
agronomYi hermes 34B
Yi · gbstox
Params34.4B
Context4K
Smallest24.3 GB
Tool use
YI
ChatAllInOne Yi 34B 200K V1
Yi · DrNicefellow
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 9B
Yi · paul-stansifer
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-9B-Chat-16K
Yi · leafspark
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
YI
brucethemoose Yi 34b Capybara 200K Fixed Temp iMat
Yi · Nexesenex
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 34B
Yi · itlwas
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
dragon yi 9b
Yi · llmware
Params8.83B
Context4K
Smallest5.3 GB
GGUF
YI
Azure99 Blossom v4 Yi 34b
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest4.2 GB
GGUF
YI
Brucethemoose Yi 34B 200K DARE Merge v7
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest3.0 GB
GGUF
YI
Master-Yi-9B
Yi · LoneStriker
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · YorkieOH10
Params6.06B
Context4K
Smallest6.4 GB
GGUF
YI
Yi 6B Chat
Yi · SinpxAI
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 1.5 34B Chat bpw3.7 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF

Keep browsing