Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 Flash Next GSQ RCO
Qwen · ISTA-DASLab
Params177B
Context256K
Smallest66.4 GB
Vision
QW
Qwen3.8-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.8-27B iMatrix NVFP4 MTP
Qwen · cdiamond
Params461M
Context256K
Smallest17.1 GB
Vision
QW
Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · SC117
Params177B
Context256K
Smallest0.9 GB
GGUF
QW
Qwen3.8-27B
Qwen · huihui-ai
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Qwen3.8 27B Uncensored
Qwen · JonathanColetti
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · HauhauCS
Params30B
Context—
Smallest0.9 GB
GGUF
QW
Qwen3.8-27B
Qwen · ggml-org
Params3B
Context256K
Q4_K_M19.0 GB
Vision
QW
Qwen Image 2.1 Uncensored Quantized
Qwen · abenzerps
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
QW
Ternary Bonsai 2 27B
Qwen · prism-ml
Params27B
Context256K
Smallest5.9 GB
Vision
QW
Qwen3.8 27B
Qwen · byteshape
Params27.3B
Context256K
Smallest8.8 GB
Vision
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · DavidAU
Params8.95B
Context256K
Q4_K_M6.8 GB
CodingReasoningRoleplay
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen Image 2.1
Qwen · unsloth
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · huihui-ai
Params35.5B
Context256K
Smallest13.2 GB
Vision
QW
Swift 1.5 Qwen3.8 27B GSQ RCO
Qwen · ukisai
Params27B
Context—
Smallest0.0 GB
Reasoning
QW
Qwen3.5-9B
Qwen · unsloth
Params8.95B
Context256K
Q4_K_M5.7 GB
Vision
QW
Qwen3.8-27B
Qwen · peculiar-ragdoll
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.6-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
Vision
QW
Qwen3.6-35B-A3B
Qwen · unsloth
Params35.5B
Context256K
Q4_K_M22.7 GB
Vision
QW
Qwen3.8 27B GSQ RCO
Qwen · ISTA-DASLab
Params27B
Context—
Smallest0.0 GB
Vision
QW
Qwen3.5-4B
Qwen · unsloth
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3.8 35B A3B Distill
Qwen · empero-ai
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningVision
QW
Qwen3Vl 8b Instruct
Qwen · Qwen
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen_Qwen3.8 27B
Qwen · lmstudio-community
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.8 Flash Next Uncensored
Qwen · orcarouter
Params177B
Context256K
Q4_K_M119.2 GB
ReasoningTool useVision
QW
Qwen3.8 Flash Next
Qwen · unsloth
Params177B
Context256K
Q4_K_M1.9 GB
Vision
QW
Qwen3.8-Flash-Next GSQ-RCO Coder
Qwen · ISTA-DASLab
Params260B
Context256K
Smallest58.4 GB
CodingVision
QW
Qwen3.5-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.0 GB
Vision
QW
MiMo V2.6 Distill Qwen 9B
Qwen · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
CodingTool useVision

About the Qwen GGUF models

Qwen is represented on ggufmodels.com by 37,395 GGUF models, quantized by 10,101 uploaders on Hugging Face. The most downloaded are Qwen3.8 Flash Next GSQ RCO, Qwen3.8-27B and Qwen3.8-27B iMatrix NVFP4 MTP. Parameter counts run from 1M to 2450B, and the longest trained context window is 3906K tokens.

A Q4_K_M file of a Qwen model is between 0.0 to 1481.4 GB, which is the quant most people start with. Most files come from mradermacher (10541), Thireus (1794) and RichardErkhov (1159). The quants you will meet most often are Q4_K_M (25162), Q8_0 (17547), Q5_K_M (17372) and Q6_K (17237), where the number is how many models offer that quant.

Frequently asked questions

Which Qwen GGUF should I download?

The most downloaded Qwen GGUF here is Qwen3.8 Flash Next GSQ RCO. Pick the size that fits your GPU first, then choose a quant: Q4_K_M is the usual starting point, and Q5_K_M or Q6_K give more quality if you have memory to spare. The VRAM pages below list what fits each GPU.

How much VRAM does a Qwen model need?

Q4_K_M files of Qwen models on this site range from 0.0 to 1481.4 GB. Add the KV cache for your context length and about 0.5 GB for the runtime, which usually means 1.5 to 3 GB on top of the file at an 8K context.

Where do Qwen GGUF files come from?

The most common quantizers here are mradermacher, Thireus and RichardErkhov. They convert the original model and publish quantized files on Hugging Face. ggufmodels.com does not host files; every download button opens Hugging Face.

Keep browsing