Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Qwen2.5 Math 7B Instruct
Qwen · bartowski
Params7.62B
Context4K
Q4_K_M4.7 GB
QW
Qwen3.5-4B-3D-Coder
Qwen · ccore
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.5 122B A10B
Qwen · bartowski
Params125B
Context256K
Q4_K_M77.6 GB
QW
Qwen3.6-35B-A3B
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
QW
Qwen3.8 27B abliterated cyber preview MTP
Qwen · hotdogs
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
qwen3-tts-tokenizer-12hz
Qwen · cstr
Params162M
Context—
Smallest0.3 GB
QW
Qwen3.5-397B-A17B
Qwen · unsloth
Params397B
Context256K
Q4_K_M244.1 GB
QW
Qwen3.8 27B ZeroRefusal UD IQ4 XS MTP
Qwen · QQZ2026
Params461M
Context—
Smallest0.0 GB
QW
Qwen3 0.6B Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3 0.6B Heretic Abliterated Uncensored
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3.8 27B GSQ RCO IQ3 XXS Uncensored
Qwen · RentedNoodle
Params27.3B
Context256K
Smallest10.4 GB
QW
Qwen3 0.6B Heretic
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3.6 35B A3B Uncensored
Qwen · xCloudinfo
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Bahushruth Qwen3.6 35B A3B Abliterated v4
Qwen · Bahushruth
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 14B Abliterated Conservative
Qwen · richardyoung
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3 Next 80B A3B Instruct
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
QW
Qwen3.5-2B
Qwen · unsloth
Params1.94B
Context256K
Q4_K_M1.3 GB
QW
Qwen_Qwen3.5 0.8B
Qwen · lmstudio-community
Params752M
Context256K
Q4_K_M0.5 GB
QW
Z Image Qwen 3 4b text encoder
Qwen · worstplayer
Params4B
Context40K
Smallest2.1 GB
QW
Qwen2.5 VL 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context125K
Q4_K_M1.9 GB
QW
Qwen3.6 35B A3B Uncensored HauhauCS MTP
Qwen · morikomorizz
Params447M
Context256K
Smallest15.9 GB
QW
Qwen3 8B Abliterated
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3 8B Hivemind Instruct Heretic Abliterated Uncensored NEO Imatrix
Qwen · DavidAU
Params7.66B
Context256K
Q4_K_M4.7 GB
QW
Qwen2.5 Coder 32b Instruct Heretic Sft
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Huihui Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen Image 2.1 GGUFs
Qwen · realrebelai
Params7.12B
Context—
Smallest4.1 GB
QW
Qwen2.5 VL 3B Instruct Abliterated
Qwen · huihui-ai
Params3.09B
Context125K
Q4_K_M1.9 GB
QW
Qwen3 0.6B Heretic Heresy Edition
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3.5 4B Uncensored LocalAI
Qwen · weareapexcreators
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.6 35B A3b pruned v2
Qwen · gatilin
Params26.6B
Context256K
Smallest16.3 GB