Reasoning GGUF models

46569 GGUF models: models that think step by step before answering. Sizes run from 1M to 5376B parameters. The longest trained context is 5120K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
VL 1 Coder Heretic
Coder · haffner
Params7.62B
Context32K
Smallest1.4 GB
CodingReasoningTool use
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · lactroiii
Params8.95B
Context256K
Q4_K_M6.8 GB
CodingReasoningRoleplay
QW
Huihui Qwen3.6 35B A3B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
IN
Index Echo S2TT 9B
Index · IndexTeam
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Huihui Qwen3 VL 8B Thinking Abliterated
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
QW
Qwen3 4B Instruct 2507 20250808 233922 0
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
OU
thesysdev_OUI 1
Oui · Abiray
Params25.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
TE
TerminalHorizon 35B A3B
Terminalhorizon · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen3.5 9b Nsfw Captioning v5
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B Heretic
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
QW
DualMinded Qwen3 1.7B
Qwen · reaperdoesntknow
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
LI
LightOnOCR 3 0.8B MTP Stage
Lightonocr · staghado
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
GE
gemma 4 E2B it DASHQ Q2
Gemma · jkim96
Params4.65B
Context128K
Smallest2.1 GB
ReasoningTool use
QW
Qwen3 VL 30B A3B Thinking Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool useVision
HO
Holo4 35B A3B GSQ RCO
Holo · lavendercomputing
Params34.7B
Context256K
Smallest13.1 GB
ReasoningTool useVision
CR
Crow 9B HERETIC 4.6
Crow · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningVision
HU
HuatuoGPT O1 8B
Huatuogpt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LF
LFM2.5 VL 450M heretic
Lfm · saidutta69
Params354M
Context125K
Q4_K_M0.2 GB
ReasoningTool useVision
QW
Qwen3.5 4B Base ZitGen V1
Qwen · lolzinventor
Params4.21B
Context256K
Smallest4.5 GB
ReasoningTool useVision
QW
Qwen3 Esper3 Reasoning CODER Instruct 12B Brainstorm20x 128k Ctx
Qwen · mradermacher
Params11.9B
Context128K
Q4_K_M7.2 GB
CodingReasoningTool use
BE
4BeastsOfApocalypse
Beastsofapocalypse · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CodingReasoningTool use
SA
Sage A1.5
Sage · el4
Params35.5B
Context256K
Smallest12.5 GB
ReasoningTool use
GE
gemma 4 e4b hindi instruct
Gemma · pankajpandey-dev
Params7.52B
Context128K
Q4_K_M5.3 GB
Reasoning
QW
Qwen3 4B Hivemind Instruct NEO MAX Imatrix
Qwen · DavidAU
Params4.41B
Context256K
Q4_K_M3.2 GB
ReasoningRoleplayTool use
QW
Qwen3 Swallow 30B A3B RL v0.2 Heretic
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
CodingReasoningTool use
GE
Gemma 4 Harmonia 31B Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
QW
Huihui Qwen3 VL 30B A3B Thinking Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool useVision
QW
Qwen 3 14B Gemini v0.1
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen_Qwen3 0.6B
Qwen · Alcoft
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
QW
Qwen3 Reranker 8b
Qwen · rugmunchmedia
Params7.57B
Context40K
Q4_K_M4.7 GB
CodingEmbeddingReasoning

Other uses

Keep browsing