Openchat GGUF models

128 GGUF models in the Openchat family, quantized by 40 uploaders. Sizes run from 7M to 13B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OP
openchat 3.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Openchat_3.5 Gpt 4 80k
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat openchat 3.5 1210
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
OP
openchat 3.5 1210
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
OP
OpenChat 3.5 0106
Openchat · second-state
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
Openchat 3.5 0106
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Openchat 3.5 1210
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat 3.5 1210
Openchat · tsunemoto
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat-3.6-8b-20240522
Openchat · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
openchat 3.5 1210
Openchat · second-state
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
Openchat 3.5 0106 32k
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Openchat3.5_Korean_V1.0_Sft
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat marunashop v3 1.0
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.5 GB
GGUF
OP
Openchat 3.5 0106
Openchat · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF
OP
openchat 3.5
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
Coding
OP
openchat-3.6-8b-20240522
Openchat · NeuralNet-Hub
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
OpenChat 3.5
Openchat · second-state
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat 3.6 8b 20240522 i1
Openchat · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
Openchat 3.5 0106 128k
Openchat · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
OP
openchat/openchat-3.6-8b-20240522
Openchat · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
OpenChat 3.5 0106_32K YaRN FT
Openchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
OP
openchat nectar 0.1
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
Openchat 3.5 0106
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
Openchat 3.5 1210
Openchat · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
Openchat 3.5 1210
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
OP
OpenChat 3.5 7B Solar i1
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing