Chocolatine GGUF models

96 GGUF models in the Chocolatine family, quantized by 19 uploaders. Sizes run from 3.82B to 78B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
CH
Chocolatine 2 14B Instruct v2.0.2 i1
Chocolatine · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
CH
Chocolatine 2 14B Instruct v2.0b2 i1 Q3 K M
Chocolatine · roleplaiapp
Params14.8B
Context128K
Smallest7.3 GB
Tool use
CH
Chocolatine 2 14B Instruct DPO v2.0b8
Chocolatine · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
CH
Chocolatine 2 14B Instruct v2.0.5 i1
Chocolatine · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
CH
Chocolatine 2 14B Instruct DPO v2.0b7
Chocolatine · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
CH
Chocolatine 2 14B Instruct DPO v2.0b8 i1
Chocolatine · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF

Keep browsing