Openthinker GGUF models
88 GGUF models in the Openthinker family, quantized by 22 uploaders. Sizes run from 1.54B to 32.8B parameters. The longest trained context is 128K tokens.
OP
OpenThinker3 7B
Openthinker · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
OP
OpenThinker 7B Q5 K S
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest5.3 GB
OP
OpenThinker 32B
Openthinker · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
OP
OpenThinker 7B f16
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest15.2 GB
OP
OpenThinker 7B IQ4 XS
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest4.2 GB
OP
OpenThinker 7B IQ3 XS
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.3 GB
OP
OpenThinker 7B Q2 K
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.0 GB
OP
OpenThinker 32B Hermes FC
Openthinker · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
OP
OpenThinker 7B Q4 K M
Openthinker · roleplaiapp
Params7.62B
Context32K
Q4_K_M4.7 GB
OP
OpenThinker 7B Q3 K S
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.5 GB
OP
OpenThinker 7B Q4 K S
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest4.5 GB
OP
OpenThinker 7B IQ3 M
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.6 GB
OP
OpenThinker 7B IQ4 NL
Openthinker · andquant
Params7.62B
Context32K
Smallest4.4 GB
OP
OpenThinker 7B Q3 K L
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest4.1 GB
OP
OpenThinker 7B Q8 0
Openthinker · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
OP
OpenThinker 7B Q3 K M
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.8 GB
OP
OpenThinker 7B Q8 0
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest8.1 GB
OP
OpenThinker 7B Q5 K M
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest5.4 GB
OP
OpenThinker2 32B
Openthinker · InfinitPLEX
Params32.8B
Context32K
Smallest14.4 GB
OP
OpenThinker Agent v1
Openthinker · hacer201145
Params8.19B
Context40K
Q4_K_M5.0 GB
OP
OpenThinker2 32B
Openthinker · InfinitPLEX
Params32.8B
Context32K
Smallest12.3 GB
OP
OpenThinker2 7B Q8 0
Openthinker · InfinitPLEX
Params7.62B
Context32K
Smallest8.1 GB
OP
OpenThinker2 32B
Openthinker · JohnRoger
Params32.8B
Context32K
Q4_K_M19.9 GB
OP
OpenThinker2 32B Uncensored
Openthinker · tebal91901
Params32.8B
Context32K
Smallest18.8 GB
OP
OpenThinker2 7B Q4 K M
Openthinker · Aldaris
Params7.62B
Context32K
Q4_K_M4.7 GB
OP
OpenThinker 7B Q6 K
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest6.3 GB
OP
OpenThinker2 32B
Openthinker · uisikdag
Params32.8B
Context32K
Q4_K_M19.9 GB
OP
OpenThinker2 7B Q4 K M
Openthinker · InfinitPLEX
Params7.62B
Context32K
Q4_K_M4.7 GB