Openchat GGUF models

128 GGUF models in the Openchat family, quantized by 40 uploaders. Sizes run from 7M to 13B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OP
Openchat 3.5 0106
Openchat · mradermacher
Params8.11B
Context8K
Q4_K_M4.9 GB
GGUF
OP
Openchat 3.5 0106
Openchat · mradermacher
Params9.86B
Context8K
Q4_K_M5.9 GB
GGUF
OP
openchat 3.5 0106 Q6 K
Openchat · newsletter
Params7.24B
Context8K
Smallest5.9 GB
GGUF
OP
Openchat 3.5 0106 32k
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Openchat 3.5 0106
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat nectar 0.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
OpenChat 3.5 7B Solar
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat openchat 3.5 0106
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
Openchat 3.5 1210
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat_openchat-3.5-0106
Openchat · zeio
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat-3.6-8b-20240522
Openchat · lmstudio-community
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
Openchat 3.5 0106 11b
Openchat · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
OP
Openchat 3.5 0106
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Openchat 3.5 0106 128k
Openchat · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
OP
openchat 3.5 0106 11b
Openchat · brittlewis12
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
OP
openchat openchat v3.2 super
Openchat · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
OP
openchat 3.6 8b 20240522
Openchat · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
OP
openchat 3.6 ko sft
Openchat · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
openchat-3.6-8b-20240522
Openchat · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
openchat marunachef v3 1.0
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat 3.5 0106
Openchat · ysn-rfd
Params7.24B
Context8K
Smallest4.1 GB
GGUF
OP
OpenChat 3.5
Openchat · SinpxAI
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
Newton 7B
Openchat · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
openchat 3.6 8b 20240522
Openchat · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
OP
openchat 3.6 8b 20240522
Openchat · SandLogicTechnologies
Params8.03B
Context8K
Q4_K_M4.9 GB
Reasoning
OP
OpenChat 3.5 1210
Openchat · SinpxAI
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat 3.5 0106
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
OP
openchat 3.6 8b 20240522
Openchat · neopolita
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
openchat 3.5 0106 Q4 K M
Openchat · itlwas
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing