Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
MiRL Qwen3.5 4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
QW
Qwen3.5 2B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningRoleplay
QW
Strand-Rust-Coder-14B-v1
Qwen · Mungert
Params14.8B
Context32K
Q4_K_M9.3 GB
Coding
QW
Fathom-Search-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.6 GB
GGUF
QW
Qwen2.5 Coder 0.5B
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Coding
QW
Qwen3 8B Abliterated
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen3 0.6B Heretic Abliterated Uncensored
Qwen · Andycurrent
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
QW
rombos Replete Coder Qwen2 1.5b i1
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingTool use
QW
Qwen3.8 27B
Qwen · williamliao
Params27.3B
Context256K
Smallest16.1 GB
GGUF
QW
Qwen1.5-MoE-A2.7B-Chat
Qwen · RichardErkhov
Params14.3B
Context32K
Q4_K_M9.5 GB
GGUF
QW
Qwen3.8-27B
Qwen · jpetrina
Params27.3B
Context256K
Smallest14.5 GB
ReasoningTool use
QW
Qwen3 VL 32B Thinking Heretic v2
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
CodingReasoningVision
QW
Qwen3.6 35B A3B REAM 160 ru agent
Qwen · WaveCut
Params23.1B
Context256K
Q4_K_M14.4 GB
GGUF
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NM DAU
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.8 27B
Qwen · xs7david
Params27.3B
Context256K
Smallest10.9 GB
Vision
QW
Qwen3.8-27B
Qwen · poisonxa
Params27.3B
Context256K
Smallest13.6 GB
GGUF
QW
Qwen3 32B VL GLM 4.7 Flash HI16 Heretic Uncensored Thinking
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningRoleplayVision
QW
Qwen3 30B A3B Instruct 2507 Pruned REAP 15B A3B
Qwen · 12bitmisfit
Params16B
Context256K
Q4_K_M9.8 GB
GGUF
QW
Qwen3 14B
Qwen · Aldaris
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.5 27B RpRMax v1
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen3.5 27B Abliterated Ko
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
QW
Qwen3-8B
Qwen · ggml-org
Params8.19B
Context40K
Smallest1.1 GB
GGUF
QW
ThinkingCap Qwen3.8 Flash-Next
Qwen · bottlecapai
Params180B
Context256K
Q4_K_M113.2 GB
ReasoningTool useVision
QW
ElisNovel V3 32B
Qwen · cyanelis
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen Qwen3 32B Heretic
Qwen · ThalisAI
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen2.5 7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Roleplay
QW
Qwen2.5 Coder 3B
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
QW
Qwen2.5-3B-Instruct
Qwen · Mungert
Params3.1B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen3 32B VL Instruct Polaris HI16 Heretic Uncensored
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
RoleplayVision
QW
RA RFT Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision

Keep browsing