Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
Yi-1.5-9B-Chat
Yi · lmstudio-community
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 6B
Yi · TheBloke
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 1.5 34B Chat Abliterated
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Capybara Tess Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 34Bx2 MOE 200K
Yi · mradermacher
Params61B
Context195K
Q4_K_M37.2 GB
GGUF
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
CodingTool use
YI
ChatAllInOne-Yi-34B-200K-V1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Faro Yi 34B
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 9B Chat 16K
Yi · QuantFactory
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
YI
Hermes-2.5-Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
Tool use
YI
brucethemoose_caplattessdolxaboros-yi-34b-200k-dare-ties-highdensity
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
ehartford_dolphin-2.2-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
dolphin-2_2-yi-34b
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
YI
ChatAllInOne Yi 34B 200K V1
Yi · second-state
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi-9B-Coder
Yi · legraphista
Params8.83B
Context4K
Smallest2.0 GB
Coding
YI
mlinmg_sg-raccoon-yi-55b-200k
Yi · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
GGUF
YI
Yi-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
dolphin 2.9.1 yi 1.5 9b
Yi · QuantFactory
Params8.83B
Context12K
Q4_K_M5.3 GB
CodingTool use
YI
Yi 9B Forest DPO v1.0
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.6 GB
GGUF
YI
Yi 70B 200k RPMerge Franken
Yi · mradermacher
Params71.2B
Context195K
Q4_K_M42.6 GB
GGUF
YI
blossom v3 1 yi 34b
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi-34Bx2-MoE-60B
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
YI
EVA Yi 1.5 9B 32K V1
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Yi 6B
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi-9b-v1.1
Yi · mradermacher
Params8.95B
Context4K
Q4_K_M5.4 GB
GGUF
YI
Faro Yi 9B 200K
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.6 GB
GGUF
YI
Yi 1.5 6B
Yi · QuantFactory
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
CursorCore Yi 9B
Yi · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
YI
Yi-1.5-9B-32K
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF

Keep browsing