Openchat GGUF models
128 GGUF models in the Openchat family, quantized by 40 uploaders. Sizes run from 7M to 13B parameters. The longest trained context is 128K tokens.
OP
openchat 3.5 0106 128k DPO
Openchat · Eric111
Params7.24B
Context128K
Q4_K_M4.4 GB
OP
openchat 3.5 1210 Q8 0
Openchat · sethut
Params7.24B
Context8K
Smallest7.7 GB
OP
Openchat_3.5_0106_Lora_Audit_Risk_R16_4Bit
Openchat · Bhavya077
Params7M
Context—
Smallest0.0 GB
OP
Openchat_3.5_0106_Lora_Audit_Risk_R16_4Bit
Openchat · Bhavya077
Params7M
Context—
Smallest0.0 GB
OP
Openchat Openchat_V2
Openchat · tensorblock
Params13B
Context2K
Smallest4.9 GB
OP
openchat
Openchat · Sabindraprimeone
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat pubchat model
Openchat · Andreaerre
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
Openchat Openchat_8192
Openchat · tensorblock
Params13B
Context8K
Smallest4.9 GB