Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
Yi-34Bx2-MoE-60B-DPO
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-6B-200K
Yi · duyntnet
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
YI
blossom v3 1 yi 34b i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
RpBird Yi 34B 200k i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
YI
Yi-34B-200K-AEZAKMI-v2
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-9B-32K
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
SG Raccoon Yi 55B
Yi · TheBloke
Params55.6B
Context4K
Q4_K_M33.3 GB
GGUF
YI
taozi555_rpbird-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi-9B-Coder
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
Coding
YI
Yi 1.5 6B Chat
Yi · QuantFactory
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-34b
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
CodingTool use
YI
Yi-9B-200K
Yi · mradermacher
Params8.83B
Context256K
Q4_K_M5.3 GB
GGUF
YI
EVA Yi 1.5 9B 32K V1
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-6B
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 1.5 9B Chat Abliterated
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-34B-200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-9b
Yi · mradermacher
Params8.83B
Context12K
Q4_K_M5.3 GB
CodingTool use
YI
Yi-1.5-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-9b
Yi · mradermacher
Params8.83B
Context12K
Q4_K_M5.3 GB
CodingTool use
YI
Mahou-1.3-yi-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
dragon yi 6B v0
Yi · TheBloke
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
CodingTool use
YI
brucethemoose_yi-34b-200k-dare-merge-v5
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Nous-Hermes-2-Yi-34B
Yi · duyntnet
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
YI
Yi-1.5-9B-coder
Yi · mradermacher
Params8.83B
Context8K
Q4_K_M5.3 GB
Coding
YI
SG Raccoon Yi 55B 200k i1
Yi · mradermacher
Params55.6B
Context195K
Q4_K_M33.3 GB
GGUF
YI
Yi-1.5-34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Hyperion 3.0 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
Coding

Keep browsing