Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Huihui Qwen3 Coder Next Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
QW
Qwen3 0.6B
Qwen · ggml-org
Params752M
Context40K
Smallest0.4 GB
QW
Qwen3.5 9B DeepSeek V4 Flash
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 VL 7B Instruct
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen2.5 72B Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3 Coder Next 0129
Qwen · Qwen
Params80B
Context256K
Q4_K_M48.4 GB
QW
Qwen3.8 27B Uncensored OrcaRouter
Qwen · chimingw
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen Image 2.1 Uncensored Abenzerps
Qwen · KasugaiSakura
Params7.12B
Context—
Q4_K_M4.6 GB
QW
qwen3 tts 0.6b customvoice
Qwen · cstr
Params906M
Context—
Smallest1.0 GB
QW
Huihui Qwen3 Coder 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen Image
Qwen · city96
Params20.4B
Context—
Q4_K_M13.1 GB
QW
Models Qwen Qwen3 4B Instruct 2507
Qwen · MaziyarPanahi
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen2.5 VL 7B Instruct
Qwen · lmstudio-community
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen Image 2.1 Turbo Uncensored
Qwen · TechnoBaptist
Params8.2B
Context256K
Smallest3.3 GB
QW
Qwen Image 2.1 PE I2I Heretic
Qwen · pottokao
Params8.95B
Context256K
Q4_K_M5.9 GB
QW
Qwen_Qwen3.5 2B
Qwen · lmstudio-community
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3.8 Flash Next Turbo Brilliance 50x Reasoning Instruct GSQ RCO
Qwen · DavidAU
Params177B
Context256K
Smallest83.6 GB
QW
Qwen3 Embedding 8B
Qwen · Qwen
Params7.57B
Context40K
Q4_K_M4.7 GB
QW
Qwen3.8 Flash Next Uncensored
Qwen · axi0mX
Params180B
Context256K
Smallest75.3 GB
QW
Qwen3-30B-A3B
Qwen · unsloth
Params30.5B
Context40K
Q4_K_M18.6 GB
QW
Models Qwen Qwen2.5 7B Instruct
Qwen · MaziyarPanahi
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.8 Flash Next Uncensored GSQ RCO 12 GB GPU
Qwen · 0xSojalSec
Params177B
Context—
Smallest0.9 GB
QW
Qwen2.5 Coder 32B Instruct AWQ
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M39.7 GB
QW
Models Qwen Qwen2.5 1.5B Instruct
Qwen · MaziyarPanahi
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2.5 72B Instruct Abliterated
Qwen · zetasepic
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen2.5 VL 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Huihui Qwen3 30B A3B Instruct 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen2 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen Image 2.1 Uncensored
Qwen · 0xSojalSec
Params7.12B
Context—
Q4_K_M4.6 GB
QW
Qwen3.8 27B Heretic JP Roleplay NSFW DanbooruTags
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB