Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Qwen2.5 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 27B Heretic JP Roleplay NSFW DanbooruTags
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 Flash Next
Qwen · apetersson
Params126B
Context256K
Smallest2.8 GB
QW
Swift Qwen3.8 Flash Next Q4 0 Q8out v3
Qwen · nitinpanj
Params177B
Context256K
Smallest102.6 GB
QW
Qwen3 8B Q8 0 full v2
Qwen · luckypoolio
Params8.19B
Context40K
Smallest8.7 GB
QW
Qwen2.5 Coder 14B Instruct 3MPER0RR Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.5 27B Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.6 35B A3B coding reap50
Qwen · anik-jha
Params18.5B
Context256K
Q4_K_M11.4 GB
QW
Qwen2.5 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5 4B RpRMax v1
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.8 27B Heretic Abliterated Uncensored
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen2.5 32B Instruct Abliterated v2
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
VideoGuard Qwen3.5 4B Safety RL Uncensored
Qwen · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · alphaduriendur
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3.6 9B Heretic Uncensored Thinking Sweet Madness
Qwen · Prototype3550
Params8.63B
Context256K
Q4_K_M5.5 GB
QW
Qwen3.6-35B-A3B
Qwen · cmp-nct
Params34.7B
Context256K
Q4_K_M22.1 GB
QW
Qwen3 48B A4B Savant Commander Distill 12X Closed Open Heretic Uncensored
Qwen · DavidAU
Params33.6B
Context256K
Q4_K_M20.4 GB
QW
Qwen3.6 28B REAP20 A3B Merged Bf16
Qwen · barozp
Params28.2B
Context256K
Q4_K_M17.3 GB
QW
qwen3 tts 1.7b base
Qwen · cstr
Params1.93B
Context—
Smallest2.1 GB
QW
Qwen3 VL 4B Instruct Unredacted MAX
Qwen · prithivMLmods
Params4B
Context256K
Smallest4.3 GB
QW
Qwen_Qwen3 Next 80B A3B Instruct
Qwen · lmstudio-community
Params80B
Context256K
Q4_K_M48.5 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive Q5 NVFP4
Qwen · AIconjured
Params1.86B
Context256K
Smallest0.9 GB
QW
Qwen/Qwen3-Next-80B-A3B-Instruct
Qwen · lefromage
Params80B
Context256K
Q4_K_M48.4 GB
QW
Qwen2 Math 1.5B Instruct
Qwen · legraphista
Params1.54B
Context4K
Smallest0.4 GB
QW
Vitus Qwen3 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3 Reranker 0.6B
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3-ForcedAligner-0.6B
Qwen · OpenVoiceOS
Params918M
Context—
Q4_K_M0.6 GB
QW
Qwen3 Esper3 Reasoning CODER Instruct 6B Brainstorm20x
Qwen · mradermacher
Params5.94B
Context40K
Q4_K_M3.6 GB