Yi GGUF models

630 GGUF models in the Yi family, quantized by 104 uploaders. Sizes run from 1.48B to 71.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YI
dolphin-2.9.1-yi-1.5-9b
Yi · bartowski
Params8.83B
Context12K
Q4_K_M5.3 GB
CodingTool use
YI
Yi 34B 200K XLCTX
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Platypus Yi 34b
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · second-state
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · gaianet
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 34B Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
adamo1139_yi-34b-200k-aezakmi-v2
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
abacusai Smaug Yi 34B v0.1 iMat
Yi · Nexesenex
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 1.5 34B Chat
Yi · tsunemoto
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi-1.5-9B-Chat-16K
Yi · gaianet
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-9b
Yi · RichardErkhov
Params8.83B
Context12K
Q4_K_M5.3 GB
GGUF
YI
Notaires_dolphin-2.9.1-yi-1.5-9b
Yi · mradermacher
Params8.83B
Context12K
Q4_K_M5.3 GB
GGUF
YI
Yi 1.5 9B
Yi · QuantFactory
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
dragon yi 1.5v 9b i1
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
HenryJJ Instruct Yi 6B Dolly CodeAlpaca
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Yi 9B Coder
Yi · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
Coding
YI
Yi 6b Dpo v0.2
Yi · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
YI
Faro Yi 34B
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
yi 34b 200k rawrr dpo 1 i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 9B 200K
Yi · MaziyarPanahi
Params8.83B
Context256K
Q4_K_M5.3 GB
GGUF
YI
HenryJJ Instruct Yi 6B Dolly15K
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
YI
Nous Hermes 2 Yi 34B iMat
Yi · qwp4w3hyb
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
YI
Yi 9B
Yi · TouchNight
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · bartowski
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
YI
Blossom v4 Yi 34b
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 34B 200K RPMerge
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 34b 200k Aezakmi Raw Toxic 2702
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
platypus yi 34b
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Faro Yi 9B DPO
Yi · duyntnet
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
YI
Gaston_dolphin-2.9.1-yi-1.5-9b
Yi · mradermacher
Params8.83B
Context12K
Q4_K_M5.3 GB
GGUF

Keep browsing