Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
asm2asm yi 1.5b 100k float16
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
GGUF
YI
Yi 9B 200K
Yi · brittlewis12
Params8.83B
Context256K
Q4_K_M5.3 GB
GGUF
YI
Yi 6B Chat Ablt
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
asm2asm yi 1.5b 10k float16
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
GGUF
YI
Boundary Coder Yi 2x6B MoE
Yi · mradermacher
Params10.4B
Context4K
Q4_K_M6.3 GB
Coding
YI
models--01-ai--Yi-1.5-6B-Chat
Yi · duolaf
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 1.5 34B Chat bpw2.25 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Bhenrym14 Airoboros 3_1 Yi 34b 200k
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
Yi 1.5 9B Chat CMC
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 6B
Yi · SamPurkis
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 9B 200K
Yi · LoneStriker
Params8.83B
Context256K
Q4_K_M5.3 GB
GGUF
YI
Yi 34B 200K
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
YI
yi 1.5 9b chat
Yi · neopolita
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Mermaid Yi 9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 6B 200K
Yi · LoneStriker
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
YI
SG Raccoon Yi 55B 200k
Yi · mradermacher
Params55.6B
Context195K
Q4_K_M33.3 GB
GGUF
YI
Yi 6B 200k v2
Yi · MarsupialAI
Params6.06B
Context195K
Smallest3.0 GB
GGUF
YI
01 Ai Yi 1.5 34B Chat 16K
Yi · tensorblock
Params34.4B
Context16K
Smallest12.8 GB
GGUF
YI
01 Ai Yi 1.5 9B Chat 16K
Yi · tensorblock
Params8.83B
Context16K
Smallest3.4 GB
GGUF
YI
Yi 34B GiftedConvo merged
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
YI
Fook-Yi-34B-32K-25p-Chat
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
YI
Yi 6B Chat Ablt
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 34B v2
Yi · tensorblock
Params34.4B
Context8K
Smallest12.8 GB
GGUF
YI
FX Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 6B Adv
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 34Bx2 MoE 60B
Yi · cloudyu
Params60.8B
Context195K
Smallest24.7 GB
GGUF
YI
blossom v4 yi 34b
Yi · Azure99
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Nous Hermes 2 Yi 34B
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
Tool use
YI
Yi 1.5 34B Chat bpw3.5 exl2
Yi · blockblockblock
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 9B
Yi · Cran-May
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF

Keep browsing