Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
Yi 1.5 34B Chat bpw5 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · YorkieOH10
Params34.4B
Context4K
Smallest36.5 GB
GGUF
YI
Yi 34B 200K
Yi · second-state
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest4.2 GB
GGUF
YI
Yi-1.5-9B-Chat-16K
Yi · leafspark
Params8.83B
Context16K
Smallest5.1 GB
GGUF
YI
Yi 1.5 6B
Yi · itlwas
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 1.5 34B 32K Magpie Ultra 0611
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
SanjiWatsuki SUS Wizard Yi 34B iMat
Yi · Nexesenex
Params34.4B
Context8K
Q4_K_M20.7 GB
GGUF
YI
Cgato Thespis Yi 34b v0.7 iMat
Yi · Nexesenex
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-6B
Yi · NikolayKozloff
Params6.06B
Context4K
Smallest6.4 GB
GGUF
YI
Yi 1.5 9B Chat
Yi · SandLogicTechnologies
Params8.83B
Context4K
Q4_K_M5.3 GB
Reasoning
YI
Yi 6b v0.3
Yi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest18.1 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest16.7 GB
GGUF
YI
Yi 6B 200K GGUF fp16
Yi · ddh0
Params6.06B
Context195K
Smallest12.1 GB
GGUF
YI
Yi 6B
Yi · SinpxAI
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · MoMonir
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 9B Petma Afk
Yi · fengpeisheng1
Params8.83B
Context4K
Smallest7.2 GB
Roleplay
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest2.7 GB
GGUF
YI
Brucethemoose CaPlatTessDolXaBoros Yi 34B 200K DARE Ties ExtremeDensity
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
Nous Hermes 2 Yi 34B
Yi · travior
Params34.4B
Context4K
Smallest19.5 GB
Tool use
YI
Yi 1.5 34B Chat bpw4.2 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
yi 1.5 9b
Yi · neopolita
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 1.5 9B
Yi · wencan-lab
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 1.5 9B
Yi · itlwas
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · CHE-72
Params6.06B
Context4K
Smallest4.3 GB
GGUF
YI
Yi 9K 200K AEZKAMI RAW TOXIC
Yi · adamo1139
Params8.83B
Context256K
Smallest5.0 GB
GGUF
YI
asm2asm yi 1.5b 100k x86 arm gnueabi gcc
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
GGUF
YI
Yi-1.5-9B
Yi · NikolayKozloff
Params8.83B
Context4K
Smallest9.4 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · leafspark
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF

Keep browsing