Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 VL 8B NSFW Caption V4.5 Heretic
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Sugoi 32B Ultra
Qwen · sugoitoolkit
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen2.5 7B Instruct Abliterated v2
Qwen · lumen-models
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.6 35B A3B MTP APEX I MiniPlus V2.1
Qwen · IsValorum
Params35.5B
Context256K
Smallest1.2 GB
ReasoningTool useVision
QW
Qwen3 4B Instruct 2507 Polaris Alpha Distill Heretic Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
Qwen3.8 27B BaseQuant V1
Qwen · basecompute
Params27.3B
Context256K
Smallest8.4 GB
ReasoningTool use
QW
dolphin-2.9.2-qwen2-72b
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
CodingTool use
QW
Huihui Qwen3.5 0.8B abliterated claude mythos distilled 25k
Qwen · azminawwar
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen3.5 27B Ultra Uncensored Heretic v2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.8 Flash Next Uncensored UD Q4 K XL
Qwen · NeosQ
Params177B
Context256K
Smallest4.1 GB
ReasoningTool useVision
QW
Qwen3 VL 8B Instruct Uncensored V2
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen2.5 14B Instruct 1M
Qwen · lmstudio-community
Params14.8B
Context986K
Q4_K_M9.0 GB
GGUF
QW
Swift 1.5 Qwen3.8 Flash Next REAP Pruned
Qwen · 90-008
Params109B
Context256K
Smallest55.3 GB
GGUF
QW
Qwen3.8 Flash Next Heretic2 IQ4XS NGQ4
Qwen · cygnal
Params177B
Context256K
Smallest98.4 GB
Vision
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Coding
QW
Raw Uncensored Qwen3 14b Heretic Recovered
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored GGUF UltraOptimised DSpark MTP
Qwen · Solstice-AI
Params26.9B
Context256K
Q4_K_M1.1 GB
ReasoningVision
QW
Qwen3 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
GGUF
QW
Qwen3VL 8B Uncensored HauhauCS Balanced
Qwen · HauhauCS
Params8.2B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen3.5 9B BOS Q8 NonThinking
Qwen · shaban2024
Params8.95B
Context256K
Smallest9.5 GB
ReasoningTool use
QW
Qwen3.8 27B Whitehat
Qwen · QuaduxIT
Params27.3B
Context256K
Q4_K_M16.8 GB
Tool useVision
QW
MiMo V2.6 Distill Qwen 9B heretic
Qwen · saidutta69
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningRoleplay
QW
Qwen3.8 Cyber RedTeam Surgical Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen3 30B A3B
Qwen · 6block
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
QW
Swift 1.5 Qwen3.8 27b MXFP4
Qwen · tsaipifong
Params27.3B
Context256K
Smallest15.5 GB
Vision
QW
Qwen3.8 Flash Next
Qwen · AesSedai
Params180B
Context256K
Q4_K_M116.1 GB
Vision
QW
Qwen3.8 27B Uncensored
Qwen · shsunshining
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
QW
Qwen2.5 Coder 1.5B
Qwen · ggml-org
Params1.54B
Context32K
Smallest1.6 GB
Coding
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
Reasoning

Keep browsing