Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Qwen3 Coder 30B A3B Instruct Heretic
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
SmartCode Fable 5 CoT Reasoning QKVO Qwen 3.6 27B Distilled
Qwen · mfielding92
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5 2B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3 30B A3B Gemini Pro High Reasoning 2507 ABLITERATED UNCENSORED
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Huihui Qwen3 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
Qwen3.5 4B Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen Image 2.1 Turbo
Qwen · molbal
Params7.12B
Context—
Q4_K_M4.5 GB
QW
Qwen2.5-Vl-72B-Instruct
Qwen · unsloth
Params72.7B
Context125K
Q4_K_M47.4 GB
QW
Qwen2.5.1 Coder 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3.8 27B Fable Distill
Qwen · TeichAI
Params27.3B
Context256K
Q4_K_M17.4 GB
QW
Qwen3.8 Flash Next
Qwen · AnonimousA
Params132B
Context256K
Smallest61.5 GB
QW
Qwen3.6 35B A3B DFlash
Qwen · magnitudedev
Params386M
Context40K
Smallest0.4 GB
QW
Qwen3 TTS 12Hz 0.6B Base
Qwen · mradermacher
Params600M
Context32K
Q4_K_M0.4 GB
QW
Qwen3.6 35B A3B DSV4Pro SFT GPT56Sol RL Agent
Qwen · nerkyor
Params34.7B
Context256K
Smallest14.3 GB
QW
Qwen3.8 2B
Qwen · piskle
Params1.94B
Context256K
Q4_K_M1.3 GB
QW
Imperum CybersecurityLLM v1.0
Qwen · IMPERUM
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5 0.8B Japanese SFT v2
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen2.5 Coder 3B Uncensored
Qwen · bappi
Params3.1B
Context32K
Q4_K_M1.9 GB
QW
ComfyUI Qwen3 VL
Qwen · Abiray
Params8.77B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 8B ERP v0.1
Qwen · Aratako
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.8 Whittle 16B
Qwen · logic65
Params16.3B
Context256K
Q4_K_M10.1 GB
QW
Huihui Qwen3.5 122B A10B Abliterated
Qwen · huihui-ai
Params122B
Context256K
Smallest74.2 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · CISCai
Params7.62B
Context32K
Smallest1.9 GB
QW
Qwen3.5 4B EmperoAI Qwen3.8 Distill Heretic Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.5 4B DFlash
Qwen · magnitudedev
Params634M
Context40K
Smallest0.7 GB
QW
Agrillm Qwen3 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen2.5 VL 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Co Rewarding I Qwen3 8B Base MATH
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
Qwen Image 2.1 Uncensored
Qwen · basileleuwa
Params7.12B
Context—
Q4_K_M4.6 GB
QW
Qwen3.5-122B-A10B
Qwen · mudler
Params122B
Context256K
Smallest48.3 GB