Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Sally QwQ
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.9 GB
QW
Qwen 3.5 9b
Qwen · protocolsyncllc
Params9.2B
Context256K
Smallest9.8 GB
QW
Qwen3.8 Distilled 2B NPU2
Qwen · Atomic-Germ
Params1.88B
Context256K
Smallest2.0 GB
QW
Qwen2.5 7B Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
QW
Qwen2.5 14B Instruct Heretic
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.8 2B Heretic Max
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
ReSearch Qwen 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen2.5 7B Instruct Abliterated v3
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 27B Unredacted MAX
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.5 27B Abliterated
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwen2.5 1.5B VibeThinker Heretic Uncensored Abliterated
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
Qwen1.5-14B-Chat
Qwen · second-state
Params14.2B
Context32K
Q4_K_M9.2 GB
QW
Qwen3.8-27B
Qwen · bsaleh03
Params26.1B
Context256K
Smallest13.6 GB
QW
Qwen3.5 21B GLM 4.7 Flash Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
QW
Qwen3.5 35B A3B Gemini 3.1 Opus 4.6 Reasoning
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
QW
Qwen2.5 72B Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest23.7 GB
QW
Huihui Qwen3.5 9B Abliterated Grimoire SimPO
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.8 27B GeoRefine D14 abl
Qwen · Tsotchke-Corporation
Params27.3B
Context256K
Smallest14.2 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · bartowski
Params480B
Context256K
Q4_K_M290.8 GB
QW
Qwen2.5 VL 3B Instruct Unredacted MAX
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
QW
QwenPaw Flash 35B A3B Q4 K M
Qwen · agentscope-ai
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Carnice Qwen3.6 MoE 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
The Omega Directive Qwen3 14B v1.1
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
CodeQwen1.5-7B-Chat
Qwen · second-state
Params7.25B
Context64K
Q4_K_M4.7 GB
QW
tabis sakha slm
Qwen · chairus
Params752M
Context256K
Smallest0.5 GB
QW
Qwen3.5-4B
Qwen · Heppygaga
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Huihui Qwen3.5 4B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.8 27B Full Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 24B A4B Freedom Thinking Abliterated Heretic NEO Imatrix
Qwen · DavidAU
Params17.5B
Context256K
Q4_K_M10.6 GB