Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Qwen2.5 14B Instruct 1M
Qwen · bartowski
Params14.8B
Context986K
Q4_K_M9.0 GB
QW
Qwen3.8 27B Uncensored Heretic MTP UD
Qwen · codavidgarcia
Params27.3B
Context256K
Smallest10.9 GB
QW
Qwen_Qwen3 VL 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
Qwen3.8-27B
Qwen · Aleks199999
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3.8 9B Abliterated 25
Qwen · MegaPanchamZ
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Huihui Qwen3 VL 4B Instruct Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen Qwen1.5 MoE A2.7B Chat
Qwen · tensorblock
Params14.3B
Context32K
Smallest5.9 GB
QW
Qwen3.8-27B
Qwen · kcarly
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3.8 Flash Next GSQ RCO
Qwen · yachiyo8080
Params177B
Context256K
Smallest66.4 GB
QW
Qwen3 8b Abliterated
Qwen · richardyoung
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.8-27B
Qwen · Fhjdjdbxhshsh
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3.5 9B
Qwen · gguf
Params9.2B
Context256K
Q4_K_M6.2 GB
QW
Qwen_Qwen3 0.6B
Qwen · lmstudio-community
Params752M
Context40K
Q4_K_M0.5 GB
QW
Qwen3-Coder-Next
Qwen · Mungert
Params79.7B
Context256K
Q4_K_M49.2 GB
QW
Qwen3 VL 8B Abliterated Caption It
Qwen · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen2.5 Coder 7B
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 27B Uncensored Heretic v1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.5 4B Uncensored
Qwen · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen3.5 0.8B Claude 4.6 Opus Reasoning Distilled
Qwen · Jackrong
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen2.5 0.5B Instruct
Qwen · ThomasBaruzier
Params494M
Context32K
Q4_K_M0.4 GB
QW
QwQ 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Gmcoder Bf16
Qwen · emperorofrome
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 VL 72B Instruct
Qwen · bartowski
Params72.7B
Context125K
Q4_K_M47.4 GB
QW
Qwen3.8 27B Uncensored
Qwen · quuyy
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · gaianet
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.8-27B
Qwen · igroc656
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
DeepSeek V4 Pro Qwen3.5 4B MTP Public 20260801 HF
Qwen · Jackrong
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen3 30B A3B Abliterated Erotic
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
QW
Qwen3.8 27B Flash MTP
Qwen · SuperLogic
Params461M
Context256K
Smallest6.2 GB
QW
Qwen2.5 VL 7B NSFW Caption V3 Abliterated
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB