Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
Yi-1.5-9B
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Platypus Yi 34b
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Nous Hermes 2 Yi 34B
Yi · NousResearch
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
YI
Yi-1.5-9B-Chat-16K
Yi · RichardErkhov
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
YI
Yi 34B Chat
Yi · second-state
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 9B Chat 16K Heretic
Yi · saidutta69
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
YI
Dolphin 2.9.1 Yi 1.5 34b Heretic
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
CodingTool use
YI
bella bartender 9b yi
Yi · juiceb0xc0de
Params8.83B
Context4K
Q4_K_M5.3 GB
Roleplay
YI
Yi 6b 200k
Yi · RichardErkhov
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · second-state
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi 9B
Yi · MaziyarPanahi
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-34Bx2-MoE-60B
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
YI
CursorCore Yi 1.5B SR i1
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
YI
CursorCore Yi 1.5B LC i1
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
YI
Yi-1.5-9B-Chat
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · second-state
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-34b
Yi · bartowski
Params34.4B
Context8K
Q4_K_M20.7 GB
CodingTool use
YI
Yi-1.5-34B-Chat
Yi · bartowski
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
models--01-ai--Yi-1.5-9B-Chat
Yi · MaziyarPanahi
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · lmstudio-community
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · qwp4w3hyb
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
brucethemoose Yi 34B 200K DARE merge v7 iMat
Yi · Nexesenex
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
dragon yi 6b v0
Yi · llmware
Params6.06B
Context4K
Q4_K_M3.7 GB
Coding
YI
Yi-1.5-34B-Chat
Yi · second-state
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 34Bx2 MoE 60B
Yi · second-state
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
YI
Yi 34B 200K HESOYAM TURTLE 0208
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · lmstudio-community
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 34B
Yi · Artefact2
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-34b
Yi · RichardErkhov
Params34.4B
Context8K
Q4_K_M20.7 GB
GGUF

Keep browsing