Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Qwen3.6-35B-A3B
Qwen · TokenTinkerer
Params34.7B
Context256K
Q4_K_M0.6 GB
QW
Ternary Bonsai 2 27B gguf dev
Qwen · prism-ml
Params27B
Context256K
Smallest7.6 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2.5 32B AGI
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
imajev 9b
Qwen · mindchain
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 4B
Qwen · ggml-org
Params4B
Context40K
Q4_K_M2.5 GB
QW
Huihui Qwen3.5 2B Abliterated
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3.8 Flash Next i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
QW
Qwen3 VL 4B Instruct
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
QW
Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 4B Abliterated
Qwen · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
QW
Qwopus3 5 9B Coder Flash Test2 MTP HF
Qwen · Jackrong
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.8 35B A3B Distill
Qwen · IsValorum
Params34.7B
Context256K
Smallest1.2 GB
QW
Qwen3.8-27B
Qwen · kingjones777
Params26.9B
Context256K
Smallest1.7 GB
QW
Qwen3.8 27B Abliterated
Qwen · prithivMLmods
Params27B
Context256K
Q4_K_M16.5 GB
QW
T-Search-Qwen3.6-35B-A3B
Qwen · t-tech
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen Image 2.1
Qwen · AlperKTS
Params7.12B
Context—
Smallest4.9 GB
QW
Qwen2.5 3B Instruct Uncensored
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen3.6 35B A3B MTP APEX I MiniPlus V2.1 Abliterated
Qwen · IsValorum
Params34.7B
Context256K
Smallest1.2 GB
QW
Qwen3.5-9B
Qwen · jc-builds
Params8.95B
Context256K
Q4_K_M5.7 GB
QW
Qwen3-Coder-30B-A3B-Instruct-1M
Qwen · unsloth
Params30.5B
Context1024K
Q4_K_M18.6 GB
QW
Huihui Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Huihui Qwen3.6 35B A3B abliterated
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 8B
Qwen · Aldaris
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Huihui Qwen3.8 27B Coder390 EfficientThink Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen3.6 12B IQ Ultra Heretic Uncensored Thinking V2 Hightop
Qwen · KevinJK51
Params11.7B
Context256K
Q4_K_M7.3 GB
QW
Qwen3.8 27B Uncensored
Qwen · xCloudinfo
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwen1.5-0.5B-Chat-AWQ-fp16
Qwen · Qwen
Params620M
Context32K
Q4_K_M0.4 GB