Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Qwen3-Vl-32B-Instruct-1M
Qwen · unsloth
Params32.8B
Context977K
Q4_K_M19.8 GB
QW
qwen3loop 0.6b sft deep supervision v1
Qwen · Lordnyx
Params596M
Context40K
Smallest0.6 GB
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3.8 Flash Next PaoAI STRIX BALANCED 2
Qwen · PaoAI
Params177B
Context256K
Smallest78.3 GB
QW
Qwen3 14B Abliterated
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Huihui Qwen3.5 9B Claude 4.6 Opus Abliterated Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
GPT neo Custom 7B
Qwen · Szymon-Wachelko
Params7.6B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.6 27B
Qwen · froggeric
Params461M
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · FrosT-LyRo
Params39.1B
Context256K
Q4_K_M23.9 GB
QW
Qwen3-Vl-2B-Thinking-1M
Qwen · unsloth
Params1.72B
Context977K
Q4_K_M1.1 GB
QW
Qwen3.8 9B Function Calling xLAM Unsloth
Qwen · ermiaazarkhalili
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Huihui Qwen3 30B A3B Thinking 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.5 9b Uncensored
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 4B
Qwen · Smoffyy
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Huihui Qwen3.8 27B Coder390 EfficientThink abliterated VAL APEX I NanoPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Smallest12.2 GB
QW
Qwen1.5-7B-Chat-AWQ-fp16
Qwen · Qwen
Params7.72B
Context32K
Q4_K_M4.8 GB
QW
Twi Qwen v1 Merged
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 VL 32B Instruct Abliterated v1
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
Qwen3.5 9B EmperoAI Qwen3.8 Distill Heretic CyberStrike
Qwen · Aapolon
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Nyx RP 9B Instruct 2608 v1
Qwen · Indexnusrefather
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.8 27B OBLITERATED Mythos Class Agentic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
OpenBuddy OpenBuddy R1 0528 Distill Qwen3 32B Preview0 QAT
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Trohrbaugh Qwen3.5 122B A10B Heretic
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
QW
Qwen3-4B-128K
Qwen · unsloth
Params4B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.5 35B RpRMax v1
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.8 Flash Coder APEX I NanoPlus
Qwen · IsValorum
Params42.6B
Context256K
Smallest18.3 GB
QW
Sakura Qwen3.8 Flash Next Swift 2.5bit 352E 32GB
Qwen · webmp3
Params139B
Context256K
Smallest57.0 GB
QW
Qwen3.8 9B Heretic Uncensored
Qwen · optionalAI
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Remnant Qwen3 8b
Qwen · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB