Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Roleplay
QW
Qwen3-Vl-32B-Instruct-1M
Qwen · unsloth
Params32.8B
Context977K
Q4_K_M19.8 GB
Vision
QW
qwen3loop 0.6b sft deep supervision v1
Qwen · Lordnyx
Params596M
Context40K
Smallest0.6 GB
ReasoningVision
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
QW
Qwen3.8 Flash Next PaoAI STRIX BALANCED 2
Qwen · PaoAI
Params177B
Context256K
Smallest78.3 GB
GGUF
QW
Qwen3 14B Abliterated
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Huihui Qwen3.5 9B Claude 4.6 Opus Abliterated Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
QW
GPT neo Custom 7B
Qwen · Szymon-Wachelko
Params7.6B
Context32K
Q4_K_M4.7 GB
Coding
QW
Qwen3.6 27B
Qwen · froggeric
Params461M
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.5 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · FrosT-LyRo
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
QW
Qwen3-Vl-2B-Thinking-1M
Qwen · unsloth
Params1.72B
Context977K
Q4_K_M1.1 GB
ReasoningVision
QW
Qwen3.8 9B Function Calling xLAM Unsloth
Qwen · ermiaazarkhalili
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
QW
Huihui Qwen3 30B A3B Thinking 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
QW
Qwen3.5 9b Uncensored
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool useVision
QW
Qwen3.5 4B
Qwen · Smoffyy
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Huihui Qwen3.8 27B Coder390 EfficientThink abliterated VAL APEX I NanoPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Smallest12.2 GB
CodingReasoningTool use
QW
Qwen1.5-7B-Chat-AWQ-fp16
Qwen · Qwen
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
QW
Twi Qwen v1 Merged
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Qwen3 VL 32B Instruct Abliterated v1
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
QW
Qwen3.5 9B EmperoAI Qwen3.8 Distill Heretic CyberStrike
Qwen · Aapolon
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
QW
Nyx RP 9B Instruct 2608 v1
Qwen · Indexnusrefather
Params9.2B
Context256K
Q4_K_M5.8 GB
Roleplay
QW
Qwen3.8 27B OBLITERATED Mythos Class Agentic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
OpenBuddy OpenBuddy R1 0528 Distill Qwen3 32B Preview0 QAT
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
Reasoning
QW
Trohrbaugh Qwen3.5 122B A10B Heretic
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
ReasoningTool use
QW
Qwen3-4B-128K
Qwen · unsloth
Params4B
Context128K
Q4_K_M2.5 GB
GGUF
QW
Qwen3.5 35B RpRMax v1
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen3.8 Flash Coder APEX I NanoPlus
Qwen · IsValorum
Params42.6B
Context256K
Smallest18.3 GB
CodingReasoningTool use
QW
Sakura Qwen3.8 Flash Next Swift 2.5bit 352E 32GB
Qwen · webmp3
Params139B
Context256K
Smallest57.0 GB
GGUF
QW
Qwen3.8 9B Heretic Uncensored
Qwen · optionalAI
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Remnant Qwen3 8b
Qwen · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
Roleplay

Keep browsing