Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 235B A22B Thinking 2507
Qwen · bartowski
Params235B
Context256K
Q4_K_M142.6 GB
Reasoning
QW
Qwen3.5 4B Instruct
Qwen · Hob-forge
Params4.33B
Context256K
Q4_K_M2.8 GB
GGUF
QW
gohumanize open humanizer
Qwen · gohumanize
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Qwen2.5 Coder 7B
Qwen · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
QW
Qwen3 Gutenberg Encore 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.5 9B Coder
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningTool use
QW
MathSmith HC Problem Synthesizer Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen Image 2.1 PE T2I Pocket 0.8B
Qwen · ML-Intern-lab
Params752M
Context256K
Smallest0.8 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use
QW
Swift 1.5 Qwen 3.8 Flash Next Heretic UD IQ4 XS
Qwen · trubisky
Params177B
Context256K
Smallest93.6 GB
ReasoningTool use
QW
PAW 27B X3
Qwen · lackonendes
Params4.85B
Context256K
Smallest0.7 GB
GGUF
QW
qwen3 4b pokerbench grpo
Qwen · YiPz
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
MathSmith HC Qwen3 8B Qwen2_5 32B ShortCoT
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen Image 2.1 Uncensored
Qwen · rayss868123
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningRoleplay
QW
qwen3 coder 30b a3b
Qwen · AlexAtomic
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
QW
Qwen2 72B Instruct
Qwen · Qwen
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen3 Coder Next Base
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Coding
QW
OpenChat 3.5 7B Qwen v2.0
Qwen · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Deductive Reasoning Qwen 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
CodingTool use
QW
Qwen3.8 27B
Qwen · Distillio
Params27.3B
Context256K
Q4_K_M17.8 GB
Vision
QW
Qwen3.8 4B Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3.5 9B Brainwaves OneJev1.6
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
QW
Qwen Flash abliterated Strata
Qwen · Hanselor
Params—
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8 27B OBLITERATED
Qwen · 007soham
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
QW
Qwen3.5-4B
Qwen · LocalScribe
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
QW
Qwen3.6 Whittle 25B A3B
Qwen · logic65
Params25.6B
Context256K
Q4_K_M15.7 GB
GGUF
QW
Qwen3 0.6B BrowserAgent
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
QW
Qwen3-Vl-235B-A22B-Instruct-1M
Qwen · unsloth
Params235B
Context977K
Q4_K_M142.2 GB
Vision

Keep browsing