Openchat GGUF models

128 GGUF models in the Openchat family, quantized by 40 uploaders. Sizes run from 7M to 13B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OP
openchat 3.5 0106 laser
Openchat · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat 3.5 1210
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
Coding
OP
Openchat_3.5 Gpt 4 80k
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
OP
MasherAI 7B v0.9
Openchat · mahiatlinux
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat 3.5 1210 Seraph Slerp
Openchat · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
OP
openchat 3.5 1210 cvparsing v1 325
Openchat · LyreZ
Params7.24B
Context8K
Smallest4.1 GB
GGUF
OP
openchat v3.2 Q4 K M
Openchat · itlwas
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
gguf sharded Q2 K openchat 3.5
Openchat · ChoLuckyHexSexySuccubusQueen135Age
Params7.24B
Context8K
Smallest3.1 GB
GGUF
OP
Openchat 3.5 0106
Openchat · RichardErkhov
Params8.11B
Context8K
Smallest3.0 GB
GGUF
OP
MasherAI 7B v1
Openchat · mahiatlinux
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
OpenChat 3.5 7B Solar
Openchat · SinpxAI
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat-3.6-8b-20240522
Openchat · heitong
Params8.03B
Context8K
Smallest8.5 GB
GGUF
OP
OpenChat 3.5 0106
Openchat · SinpxAI
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat 3.5 1210 Q4 K M
Openchat · itlwas
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
OP
Openchat 3.5 0106
Openchat · RichardErkhov
Params8.11B
Context8K
Smallest3.0 GB
GGUF
OP
openchat v3.2 super
Openchat · actionpace
Params13B
Context4K
Smallest9.8 GB
GGUF
OP
openchat-3.6-8b-20240522
Openchat · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
openchat 3.5 0106
Openchat · Eric111
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat 3.5 Q4 K M
Openchat · brekJ
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
OP
openchat 3.5
Openchat · ysn-rfd
Params7.24B
Context8K
Smallest4.1 GB
Coding
OP
openchat 3.5 0106 GGUF fp16
Openchat · ddh0
Params7.24B
Context8K
Smallest14.5 GB
GGUF
OP
openchat 3.6 8b 20240522 Q8 0
Openchat · sethut
Params8.03B
Context8K
Smallest8.5 GB
GGUF
OP
openchat 3.5 Q4 K M
Openchat · itlwas
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
OP
openchat 3.5 GGUF fp16
Openchat · ddh0
Params7.24B
Context8K
Smallest14.5 GB
GGUF
OP
openchat 3.5 0106
Openchat · senseable
Params7.24B
Context8K
Smallest5.1 GB
GGUF
OP
openchat v3.2 super Q4 K M
Openchat · itlwas
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
openchat 3.5
Openchat · tsunemoto
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat 3.5 0106
Openchat · DIVY118
Params7.24B
Context8K
Smallest2.7 GB
GGUF
OP
openchat 3.5 Q5 K M
Openchat · SHIBA212121
Params7.24B
Context8K
Smallest5.1 GB
Coding
OP
openchat 3.5 Q8 0
Openchat · ysn-rfd
Params7.24B
Context8K
Smallest7.7 GB
Coding

Keep browsing