Openchat GGUF models
128 GGUF models in the Openchat family, quantized by 40 uploaders. Sizes run from 7M to 13B parameters. The longest trained context is 128K tokens.
OP
Openchat 3.5 0106
Openchat · mradermacher
Params8.11B
Context8K
Q4_K_M4.9 GB
OP
Openchat 3.5 0106
Openchat · mradermacher
Params9.86B
Context8K
Q4_K_M5.9 GB
OP
openchat 3.5 0106 Q6 K
Openchat · newsletter
Params7.24B
Context8K
Smallest5.9 GB
OP
Openchat 3.5 0106 32k
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Openchat 3.5 0106
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat nectar 0.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
OpenChat 3.5 7B Solar
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat openchat 3.5 0106
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
Openchat 3.5 1210
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat_openchat-3.5-0106
Openchat · zeio
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat-3.6-8b-20240522
Openchat · lmstudio-community
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
Openchat 3.5 0106 11b
Openchat · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
OP
Openchat 3.5 0106
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Openchat 3.5 0106 128k
Openchat · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
OP
openchat 3.5 0106 11b
Openchat · brittlewis12
Params10.7B
Context32K
Q4_K_M6.5 GB
OP
openchat openchat v3.2 super
Openchat · tensorblock
Params13B
Context4K
Smallest4.9 GB
OP
openchat 3.6 8b 20240522
Openchat · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
OP
openchat 3.6 ko sft
Openchat · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
openchat-3.6-8b-20240522
Openchat · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
openchat marunachef v3 1.0
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat 3.5 0106
Openchat · ysn-rfd
Params7.24B
Context8K
Smallest4.1 GB
OP
OpenChat 3.5
Openchat · SinpxAI
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
Newton 7B
Openchat · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
openchat 3.6 8b 20240522
Openchat · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OP
openchat 3.6 8b 20240522
Openchat · SandLogicTechnologies
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
OpenChat 3.5 1210
Openchat · SinpxAI
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat 3.5 0106
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
OP
openchat 3.6 8b 20240522
Openchat · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
openchat 3.5 0106 Q4 K M
Openchat · itlwas
Params7.24B
Context8K
Q4_K_M4.4 GB