Yi GGUF models
630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.
YI
Yi-1.5-9B-Chat
Yi · lmstudio-community
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi 6B
Yi · TheBloke
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi 1.5 34B Chat Abliterated
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Capybara Tess Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 34Bx2 MOE 200K
Yi · mradermacher
Params61B
Context195K
Q4_K_M37.2 GB
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
ChatAllInOne-Yi-34B-200K-V1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Faro Yi 34B
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 1.5 9B Chat 16K
Yi · QuantFactory
Params8.83B
Context16K
Q4_K_M5.3 GB
YI
Hermes-2.5-Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
brucethemoose_caplattessdolxaboros-yi-34b-200k-dare-ties-highdensity
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
ehartford_dolphin-2.2-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
dolphin-2_2-yi-34b
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
YI
ChatAllInOne Yi 34B 200K V1
Yi · second-state
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi-9B-Coder
Yi · legraphista
Params8.83B
Context4K
Smallest2.0 GB
YI
mlinmg_sg-raccoon-yi-55b-200k
Yi · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
YI
Yi-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
dolphin 2.9.1 yi 1.5 9b
Yi · QuantFactory
Params8.83B
Context12K
Q4_K_M5.3 GB
YI
Yi 9B Forest DPO v1.0
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.6 GB
YI
Yi 70B 200k RPMerge Franken
Yi · mradermacher
Params71.2B
Context195K
Q4_K_M42.6 GB
YI
blossom v3 1 yi 34b
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi-34Bx2-MoE-60B
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
YI
EVA Yi 1.5 9B 32K V1
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
YI
Yi 6B
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
Yi-9b-v1.1
Yi · mradermacher
Params8.95B
Context4K
Q4_K_M5.4 GB
YI
Faro Yi 9B 200K
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.6 GB
YI
Yi 1.5 6B
Yi · QuantFactory
Params6.06B
Context4K
Q4_K_M3.7 GB
YI
CursorCore Yi 9B
Yi · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
YI
Yi-1.5-9B-32K
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB