Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen3.8 27B Heretic JP Roleplay NSFW DanbooruTags
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
RoleplayVision
QW
Qwen3.8 Flash Next
Qwen · apetersson
Params126B
Context256K
Smallest2.8 GB
Vision
QW
Swift Qwen3.8 Flash Next Q4 0 Q8out v3
Qwen · nitinpanj
Params177B
Context256K
Smallest102.6 GB
Vision
QW
Qwen3 8B Q8 0 full v2
Qwen · luckypoolio
Params8.19B
Context40K
Smallest8.7 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct 3MPER0RR Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
QW
Qwen3.5 27B Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.6 35B A3B coding reap50
Qwen · anik-jha
Params18.5B
Context256K
Q4_K_M11.4 GB
Coding
QW
Qwen2.5 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3.5 4B RpRMax v1
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
QW
Qwen3.8 27B Heretic Abliterated Uncensored
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen2.5 32B Instruct Abliterated v2
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
VideoGuard Qwen3.5 4B Safety RL Uncensored
Qwen · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningVision
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · alphaduriendur
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Qwen3.6 9B Heretic Uncensored Thinking Sweet Madness
Qwen · Prototype3550
Params8.63B
Context256K
Q4_K_M5.5 GB
ReasoningRoleplayVision
QW
Qwen3.6-35B-A3B
Qwen · cmp-nct
Params34.7B
Context256K
Q4_K_M22.1 GB
Vision
QW
Qwen3 48B A4B Savant Commander Distill 12X Closed Open Heretic Uncensored
Qwen · DavidAU
Params33.6B
Context256K
Q4_K_M20.4 GB
Reasoning
QW
Qwen3.6 28B REAP20 A3B Merged Bf16
Qwen · barozp
Params28.2B
Context256K
Q4_K_M17.3 GB
GGUF
QW
qwen3 tts 1.7b base
Qwen · cstr
Params1.93B
Context—
Smallest2.1 GB
GGUF
QW
Qwen3 VL 4B Instruct Unredacted MAX
Qwen · prithivMLmods
Params4B
Context256K
Smallest4.3 GB
Vision
QW
Qwen_Qwen3 Next 80B A3B Instruct
Qwen · lmstudio-community
Params80B
Context256K
Q4_K_M48.5 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive Q5 NVFP4
Qwen · AIconjured
Params1.86B
Context256K
Smallest0.9 GB
GGUF
QW
Qwen/Qwen3-Next-80B-A3B-Instruct
Qwen · lefromage
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
QW
Qwen2 Math 1.5B Instruct
Qwen · legraphista
Params1.54B
Context4K
Smallest0.4 GB
GGUF
QW
Vitus Qwen3 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen3 Reranker 0.6B
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
Embedding
QW
Qwen3-ForcedAligner-0.6B
Qwen · OpenVoiceOS
Params918M
Context—
Q4_K_M0.6 GB
GGUF
QW
Qwen3 Esper3 Reasoning CODER Instruct 6B Brainstorm20x
Qwen · mradermacher
Params5.94B
Context40K
Q4_K_M3.6 GB
CodingReasoning

Keep browsing