Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 1.7B
Qwen · rippertnt
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
QW
Qwen3.5-4B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · Andycurrent
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3 0.6B
Qwen · NobodyWho
Params752M
Context32K
Q4_K_M0.5 GB
GGUF
QW
Qwen2.5 32B Instruct abliterated v2
Qwen · zetasepic
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · grainrigi
Params177B
Context256K
Smallest0.9 GB
GGUF
QW
Suri Qwen 3.8 27B Neuro
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3 VL 4B Instruct Uncensored
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
FlashModel Qwen 3.6 35B A3B Maxed
Qwen · flashback2k
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
QW
Qwen2.5 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen2.5 7b Alpaca
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
ThinCtx Qwen3.5 0.8B
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · ThomasBaruzier
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3.6 40B Grand Intelligence Fable Fusion Uncensored Heretic NM DAU NEO MAX MTP
Qwen · DavidAU
Params461M
Context256K
Q4_K_M25.9 GB
CodingReasoningRoleplay
QW
Qwen2.5 Coder 14B Instruct AWQ
Qwen · EasierAI
Params14.8B
Context128K
Q4_K_M9.0 GB
Coding
QW
Qwen3 Coder 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Ostrich 27B 261008 Qwen3.8 Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
ThinCtx Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
QW
Qwen3.5 DeltaCoder 9B
Qwen · danielcherubini
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
QW
Qwen3 VL 8B Thinking Unredacted MAX
Qwen · prithivMLmods
Params8.19B
Context256K
Smallest8.7 GB
ReasoningVision
QW
Qwen3.8 4b Heretic Trial23
Qwen · hakergeniusz
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
QW
Qwen3.5 35B A3B uncensored heretic
Qwen · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.8-Flash-CIRU-STRIX-IU4-MTP
Qwen · jcbtc
Params126B
Context256K
Smallest4.1 GB
Vision
QW
Qwen3.5 27B Writer V2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.6 21B IQ Ultra Heretic Uncensored Thinking
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
ReasoningRoleplay
QW
Qwen2.5 VL 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
Qwen2-7B
Qwen · legraphista
Params7.62B
Context128K
Smallest1.9 GB
GGUF
QW
Qwen2.5 Coder 14B n8n Workflow Generator
Qwen · mbakgun
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
QW
qwen2.5 14B roleplay zh Q4 K M
Qwen · TouchNight
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
QW
Qwen3 14B GPT 5.2 High Reasoning Distill
Qwen · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning

Keep browsing