Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Qwen3 4B Abliterated
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
QW
MiMo-V2.6-Distill-Qwen-9B
Qwen · ggml-org
Params8.95B
Context256K
Smallest9.5 GB
QW
Qwen3 14B Abliterated
Qwen · AIgotahole
Params14.8B
Context40K
Smallest8.6 GB
QW
Qwen2.5 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
QW
Huihui Qwen3.5 9B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Dongfangshuo Qwen3.8 27B NSFW
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwopus3.6 35B A3B v1
Qwen · Jackrong
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5 9B The Defiant Fable DARK ROAST Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.8 27B Heretic
Qwen · darrellbest
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
shisa v2.1 qwen3 8b
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Ingot 27B DFlash2
Qwen · dendriteholdings
Params1.92B
Context256K
Smallest2.1 GB
QW
Qwen3.8 27B Med Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.5 122B A10B Abliterated
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3.8 27B Max Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3 4B Instruct 2507
Qwen · ggml-org
Params4B
Context256K
Smallest4.3 GB
QW
Qwen3.6-35B-A3B
Qwen · peculiar-ragdoll
Params447M
Context256K
Smallest14.1 GB
QW
Qwen3.5 27B WebNovel Writer Zh
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Swift Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M125.6 GB
QW
Qwen3 VL Embedding 8B
Qwen · VesNFF
Params7.6B
Context256K
Smallest6.2 GB
QW
cerebras/Qwen3-Coder-REAP-25B-A3B
Qwen · bartowski
Params25B
Context256K
Q4_K_M15.2 GB
QW
Qwen3.5 9B Gemini 3.1 Pro Reasoning Distill
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.7 GB
QW
Qwen3 Swallow 8B RL v0.2
Qwen · mmnga-o
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
QW
sakura-8b-qwen3-v1.1
Qwen · SakuraLLM
Params8.2B
Context32K
Smallest4.6 GB
QW
ThinkingCap Qwen3.6 27B abliterated MTP
Qwen · protoLabsAI
Params27.3B
Context—
Q4_K_M16.8 GB
QW
Agnes 3.0 Qwen
Qwen · bartowski
Params180B
Context1024K
Q4_K_M127.1 GB
QW
Qwen3.5 4B GGUF shards
Qwen · Arki05
Params4B
Context—
Smallest0.0 GB