Openthinker GGUF models

88 GGUF models in the Openthinker family, quantized by 22 uploaders. Sizes run from 1.54B to 32.8B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
OP
OpenThinker3 7B
Openthinker · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
Tool use
OP
OpenThinker 7B Q5 K S
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest5.3 GB
Tool use
OP
OpenThinker 32B
Openthinker · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
Tool use
OP
OpenThinker 7B f16
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest15.2 GB
Tool use
OP
OpenThinker 7B IQ4 XS
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest4.2 GB
Tool use
OP
OpenThinker 7B IQ3 XS
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.3 GB
Tool use
OP
OpenThinker 7B Q2 K
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.0 GB
Tool use
OP
OpenThinker 32B Hermes FC
Openthinker · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
OP
OpenThinker 7B Q4 K M
Openthinker · roleplaiapp
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
OP
OpenThinker 7B Q3 K S
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.5 GB
Tool use
OP
OpenThinker 7B Q4 K S
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest4.5 GB
Tool use
OP
OpenThinker 7B IQ3 M
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.6 GB
Tool use
OP
OpenThinker 7B IQ4 NL
Openthinker · andquant
Params7.62B
Context32K
Smallest4.4 GB
Tool use
OP
OpenThinker 7B Q3 K L
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest4.1 GB
Tool use
OP
OpenThinker 7B Q8 0
Openthinker · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
Tool use
OP
OpenThinker 7B Q3 K M
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.8 GB
Tool use
OP
OpenThinker 7B Q8 0
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest8.1 GB
Tool use
OP
OpenThinker 7B Q5 K M
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest5.4 GB
Tool use
OP
OpenThinker2 32B
Openthinker · InfinitPLEX
Params32.8B
Context32K
Smallest14.4 GB
Tool use
OP
OpenThinker Agent v1
Openthinker · hacer201145
Params8.19B
Context40K
Q4_K_M5.0 GB
CodingReasoningTool use
OP
OpenThinker2 32B
Openthinker · InfinitPLEX
Params32.8B
Context32K
Smallest12.3 GB
Tool use
OP
OpenThinker2 7B Q8 0
Openthinker · InfinitPLEX
Params7.62B
Context32K
Smallest8.1 GB
Tool use
OP
OpenThinker2 32B
Openthinker · JohnRoger
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
OP
OpenThinker2 32B Uncensored
Openthinker · tebal91901
Params32.8B
Context32K
Smallest18.8 GB
Tool use
OP
OpenThinker2 7B Q4 K M
Openthinker · Aldaris
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
OP
OpenThinker 7B Q6 K
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest6.3 GB
Tool use
OP
OpenThinker2 32B
Openthinker · uisikdag
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
OP
OpenThinker2 7B Q4 K M
Openthinker · InfinitPLEX
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use

Keep browsing