Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 3B Instruct
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
qmd query expansion 1.7B
Qwen · tobil
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
QW
Qwen3 4B Instruct 2507
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · pentacoxian-dev
Params180B
Context256K
Smallest85.9 GB
GGUF
QW
Qwen3 30B A3B Instruct 2507
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen3.6 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking NEO CODE Di IMatrix MAX
Qwen · DavidAU
Params39.1B
Context256K
Q4_K_M24.3 GB
CodingReasoningRoleplay
QW
Qwen3-Next-80B-A3B-Instruct
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
GGUF
QW
Models Qwen Qwen3 0.6B
Qwen · MaziyarPanahi
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
QW
Qwen3.5-122B-A10B
Qwen · unsloth
Params125B
Context256K
Q4_K_M78.3 GB
Vision
QW
Qwen3.8 27B
Qwen · AtomicChat
Params27.3B
Context256K
Q4_K_M17.1 GB
ReasoningTool useVision
QW
Qwen3Vl 30b A3B Instruct
Qwen · Qwen
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
QW
Qwen3-14B
Qwen · unsloth
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Models Qwen Qwen3 4B
Qwen · MaziyarPanahi
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Qwen3.6-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M17.1 GB
Vision
QW
Huihui Qwen3.5 4B Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
QW
Qwen3Vl 32b Instruct
Qwen · Qwen
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
QW
Models Qwen Qwen3 14B
Qwen · MaziyarPanahi
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Models Qwen Qwen3 1.7B
Qwen · MaziyarPanahi
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
QW
Ternary-Bonsai-2-4B
Qwen · prism-ml
Params782M
Context256K
Smallest0.9 GB
Vision
QW
Qwen2.5 Coder 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
QW
Models Qwen Qwen3 8B
Qwen · MaziyarPanahi
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Huihui Qwen3 14B Abliterated v2
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen_Qwen3.5 35B A3B
Qwen · lmstudio-community
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.8-Flash-Next
Qwen · ggml-org
Params177B
Context256K
Smallest0.4 GB
Vision
QW
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params27B
Context256K
Smallest10.0 GB
Vision
QW
Huihui Qwen3 8B Abliterated v2
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Models Qwen Qwen3 30B A3B
Qwen · MaziyarPanahi
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
QW
Qwen3 Omni 30B A3B Instruct
Qwen · ggml-org
Params30.5B
Context64K
Q4_K_M18.6 GB
Vision
QW
Models Qwen Qwen3 32B
Qwen · MaziyarPanahi
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Huihui Qwen3.6 27B Abliterated
Qwen · huihui-ai
Params27.3B
Context256K
Smallest10.9 GB
Vision

Keep browsing