Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3Vl 4b Thinking
Qwen · Qwen
Params4B
Context256K
Q4_K_M2.5 GB
ReasoningVision
QW
Qwen3.8 Flash Next Orca Abliterated GSQ RCO Coder
Qwen · Abiray
Params117B
Context256K
Smallest58.7 GB
CodingReasoningTool use
QW
Qwen3 Vl 4b Heretic
Qwen · DreamFast
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
Qwen3.8 27B Uncensored Heretic Native MTP Preserved NVFP4
Qwen · llmfan46
Params27.3B
Context256K
Smallest16.9 GB
Vision
QW
Huihui Qwen3.8 27B Abliterated
Qwen · IsValorum
Params27.3B
Context256K
Smallest14.2 GB
ReasoningVision
QW
Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen3.5 4B Heretic
Qwen · Biomanticus
Params4.21B
Context256K
Smallest2.7 GB
GGUF
QW
Qwenmodel1st
Qwen · atypical-chai
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Qwen3Vl 30b A3B Thinking
Qwen · Qwen
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningVision
QW
Huihui ai.Qwen3 8B Abliterated
Qwen · DevQuasar
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · Cyronius
Params132B
Context256K
Smallest64.8 GB
Embedding
QW
Qwen3.8-27B
Qwen · Kaktus4048
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Bella Bartender Qwen3.5 2b
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
QW
Qwen3 Next 80B A3B Thinking GRPO Uncensored
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.5 GB
Reasoning
QW
Qwen2.5 VL 32B Instruct Heretic
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
CodingVision
QW
Qwen3-Coder-Next
Qwen · mudler
Params79.7B
Context256K
Smallest31.4 GB
Coding
QW
Qwen3.6 35B A3B
Qwen · byteshape
Params35.5B
Context256K
Smallest10.0 GB
Vision
QW
qwen3 tts 0 6b custom voice mix precision
Qwen · Arm
Params83M
Context8K
Smallest0.0 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · ThomasBaruzier
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
DarkIdol Qwen3.8 27B v1.1
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayVision
QW
Qwen3.5-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M17.1 GB
Vision
QW
PAW 27B X3.1
Qwen · lackonendes
Params4.86B
Context256K
Smallest0.7 GB
GGUF
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
Reasoning
QW
Qwen3.8-Flash-Next GSQ-RCO Coder
Qwen · DatKurai
Params117B
Context256K
Smallest58.7 GB
CodingVision
QW
qwen3.8 flash coder 26gb
Qwen · Jab1718
Params42.6B
Context256K
Q4_K_M28.4 GB
Coding
QW
Qwen2.5 Coder 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
QW
Qwen3 Omni 30B A3B Captioner
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
Vision
QW
Onego_Osearch_Popular_Wiki_Qwen05B_V2_Merged
Qwen · onegoai
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen3.5 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen2.5 Coder 0.5B Instruct Gensyn Swarm tall tame panther
Qwen · 0xgr3y
Params494M
Context32K
Q4_K_M0.4 GB
Coding

Keep browsing