Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO MTP DFlash2
Qwen · Arkha7
Params461M
Context256K
Smallest13.3 GB
GGUF
QW
qwen2.5 coder 32b bitnet 1.58b
Qwen · tzervas
Params32.8B
Context32K
Smallest11.2 GB
Coding
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
QW
Kataguru Sceptic 35B A3B v2.6
Qwen · kataguru
Params35.2B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Qwen2.5-Omni-3B
Qwen · unsloth
Params3.4B
Context32K
Q4_K_M2.1 GB
Vision
QW
Qwen3.6 Qworus 35B A3B V1 APEX
Qwen · DarkKitsune
Params35.5B
Context256K
Smallest18.5 GB
CodingReasoningTool use
QW
Qwen2.5 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Huihui Qwen3 4B Abliterated v2
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Qwen3 4B Thinking 2507
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
QW
Qwen2.5 VL 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3.5 0.8 Cyber
Qwen · reaperdoesntknow
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen2.5 72B Instruct Abliterated
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen3.5 2B CyberSec
Qwen · reaperdoesntknow
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Atomic Chat / Qwen3.6 35B A3B
Qwen · AtomicChat
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Qwen3.8 27B
Qwen · slothingaway
Params27.3B
Context256K
Smallest29.0 GB
ReasoningTool useVision
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · shefowl
Params177B
Context256K
Smallest67.2 GB
Vision
QW
GELab-Zero-4B-preview
Qwen · Mungert
Params4B
Context256K
Q4_K_M2.6 GB
Vision
QW
Qwen3 Vl 8b Heretic 1.3.0
Qwen · DreamFast
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Huihui Qwen3 14B Abliterated v2
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.8 27B Q3 K M
Qwen · Chungulus
Params27.3B
Context256K
Smallest13.5 GB
Vision
QW
Carnice Qwen3.6 MoE 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
Tool use
QW
Qwen3.5 27B Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
CodingVision
QW
Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.5 35B A3B
Qwen · ggml-org
Params34.7B
Context256K
Smallest36.9 GB
Vision
QW
Qwen2.5 Coder 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
QW
Qwen Image Edit
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
QW
Qwen_Qwen3.5 122B A10B
Qwen · lmstudio-community
Params122B
Context256K
Q4_K_M74.2 GB
Vision
QW
Qwen3.8 35B A3B Distill
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
QW
Qwen3.8 27B
Qwen · ArtomYuan
Params27.3B
Context256K
Smallest14.6 GB
Vision
QW
Qwen3.8-2.4T-A95B
Qwen · unsloth
Params2450B
Context256K
Smallest397.3 GB
GGUF

Keep browsing