Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.6 27B AEON Ultimate Uncensored
Qwen · Abiray
Params27B
Context256K
Q4_K_M16.5 GB
RoleplayVision
QW
Qwen2.5 Coder 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QW
Mica v0.5 4B
Qwen · sky7350
Params4.21B
Context256K
Smallest2.5 GB
ReasoningTool use
QW
Qwen3.8-27B
Qwen · AI-conn
Params27.3B
Context256K
Q4_K_M16.6 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct Heretic
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
QwQ 32B
Qwen · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
QW
Qwen3.5 2B Uncensored Zero Refusal SOMA
Qwen · AkaumiKaede
Params1.88B
Context256K
Q4_K_M1.3 GB
RoleplayVision
QW
Qwen3.5 9b Uncensored
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool use
QW
MiMo V2.6 Distill Qwen 9B Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningRoleplay
QW
Qwen3.8-27B
Qwen · xrachelburns
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Huihui Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct RTPurbo
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Qwen3.5 35B A3B Base
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.5 122B A10B Heretic
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
Vision
QW
Qwen25 Coder 3b Claude
Qwen · ryzdfm
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingReasoning
QW
Rice Cracker Qwen3.5 0.8B Abliterated Base
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Coding
QW
Huihui Qwen3.6 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen Image 2.1 Anime Fusal
Qwen · LocalAI-io
Params7.12B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen3.8-27B
Qwen · Shishkipiski
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
QW
Qwen3 8B Q8 0 full v2
Qwen · RacerMiner
Params8.19B
Context40K
Smallest8.7 GB
GGUF
QW
Qwen3.8-27B
Qwen · Bucoid
Params27.3B
Context256K
Smallest13.9 GB
GGUF
QW
Qwen3.8 27B MIX
Qwen · vmarcelo
Params27.3B
Context256K
Smallest12.6 GB
Vision
QW
Qwen3.5 14B A3B Claude 4.6 Opus Reasoning Distilled Reap
Qwen · brunopio
Params14.1B
Context256K
Q4_K_M8.7 GB
Reasoning
QW
Qwen3.8-27B
Qwen · yachiyo8080
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
QW
qwen image
Qwen · calcuis
Params20.4B
Context—
Q4_K_M11.7 GB
GGUF
QW
Carnice Qwen3.6 MoE 35B A3B APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
GGUF
QW
qwen3.5 9B super coder
Qwen · jica98
Params9.2B
Context256K
Smallest5.5 GB
CodingVision
QW
Qwen2.5 14B Instruct
Qwen · TheRains
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.5 27B Writer V2 Uncensored Heretic
Qwen · llmfan46
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen Image 2512
Qwen · byteshape
Params20.4B
Context—
Q4_K_M11.4 GB
GGUF

Keep browsing