Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Sally QwQ
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.9 GB
ReasoningTool use
QW
Qwen 3.5 9b
Qwen · protocolsyncllc
Params9.2B
Context256K
Smallest9.8 GB
ReasoningTool use
QW
Qwen3.8 Distilled 2B NPU2
Qwen · Atomic-Germ
Params1.88B
Context256K
Smallest2.0 GB
ReasoningVision
QW
Qwen2.5 7B Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
Tool use
QW
Qwen2.5 14B Instruct Heretic
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.8 2B Heretic Max
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
QW
ReSearch Qwen 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 7B Instruct Abliterated v3
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.5 27B Unredacted MAX
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Reasoning
QW
Qwen3.5 27B Abliterated
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
QW
Qwen2.5 1.5B VibeThinker Heretic Uncensored Abliterated
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
QW
Qwen1.5-14B-Chat
Qwen · second-state
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
QW
Qwen3.8-27B
Qwen · bsaleh03
Params26.1B
Context256K
Smallest13.6 GB
GGUF
QW
Qwen3.5 21B GLM 4.7 Flash Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
CodingReasoningRoleplay
QW
Qwen3.5 35B A3B Gemini 3.1 Opus 4.6 Reasoning
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
CodingTool use
QW
Qwen2.5 72B Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest23.7 GB
Tool use
QW
Huihui Qwen3.5 9B Abliterated Grimoire SimPO
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen3.8 27B GeoRefine D14 abl
Qwen · Tsotchke-Corporation
Params27.3B
Context256K
Smallest14.2 GB
GGUF
QW
Qwen3 Coder 480B A35B Instruct
Qwen · bartowski
Params480B
Context256K
Q4_K_M290.8 GB
Coding
QW
Qwen2.5 VL 3B Instruct Unredacted MAX
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
QwenPaw Flash 35B A3B Q4 K M
Qwen · agentscope-ai
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Carnice Qwen3.6 MoE 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool use
QW
The Omega Directive Qwen3 14B v1.1
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
Roleplay
QW
CodeQwen1.5-7B-Chat
Qwen · second-state
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
QW
tabis sakha slm
Qwen · chairus
Params752M
Context256K
Smallest0.5 GB
ReasoningTool use
QW
Qwen3.5-4B
Qwen · Heppygaga
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
QW
Huihui Qwen3.5 4B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
Reasoning
QW
Qwen3.8 27B Full Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3 24B A4B Freedom Thinking Abliterated Heretic NEO Imatrix
Qwen · DavidAU
Params17.5B
Context256K
Q4_K_M10.6 GB
ReasoningRoleplay

Keep browsing