Openchat GGUF models
128 GGUF models in the Openchat family, quantized by 40 uploaders. Sizes run from 7M to 13B parameters. The longest trained context is 128K tokens.
OP
openchat 3.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Openchat_3.5 Gpt 4 80k
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat openchat 3.5 1210
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat 3.5 1210
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
OpenChat 3.5 0106
Openchat · second-state
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
Openchat 3.5 0106
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Openchat 3.5 1210
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat 3.5 1210
Openchat · tsunemoto
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat-3.6-8b-20240522
Openchat · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
openchat 3.5 1210
Openchat · second-state
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
Openchat 3.5 0106 32k
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Openchat3.5_Korean_V1.0_Sft
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat marunashop v3 1.0
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.5 GB
OP
Openchat 3.5 0106
Openchat · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
OP
openchat 3.5
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
OP
openchat-3.6-8b-20240522
Openchat · NeuralNet-Hub
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
OpenChat 3.5
Openchat · second-state
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat 3.6 8b 20240522 i1
Openchat · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
Openchat 3.5 0106 128k
Openchat · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
OP
openchat/openchat-3.6-8b-20240522
Openchat · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
OpenChat 3.5 0106_32K YaRN FT
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat nectar 0.1
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
Openchat 3.5 0106
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
Openchat 3.5 1210
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
Openchat 3.5 1210
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
OpenChat 3.5 7B Solar i1
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB