Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
Vision
QW
Huihui Qwen3.8 Flash Next abliterated v2
Qwen · huihui-ai
Params177B
Context—
Smallest1.2 GB
ReasoningVision
QW
Qwen3.5-0.8B
Qwen · unsloth
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen-Agentworld-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
GGUF
QW
Ternary-Bonsai-2-2B
Qwen · prism-ml
Params1.88B
Context256K
Smallest0.4 GB
Vision
QW
Qwopus3.6 27B Fusion
Qwen · KyleHessling1
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningVision
QW
Qwen2.5-Vl-7B-Instruct
Qwen · unsloth
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3-ASR 1.7B
Qwen · handy-computer
Params2.04B
Context—
Q4_K_M1.3 GB
GGUF
QW
qwen2.5-3b-instruct
Qwen · Qwen
Params3.4B
Context32K
Q4_K_M2.1 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct GGUF
Qwen · Qwen
Params1.78B
Context32K
Q4_K_M1.1 GB
Coding
QW
Qwen2.5 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.5-4B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · HauhauCS
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3-1.7B
Qwen · unsloth
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
QW
Qwen3 0.6B Instruct
Qwen · Qwen
Params596M
Context40K
Smallest0.6 GB
GGUF
QW
Parable Qwen3 8B Claude Fable 5
Qwen · AnkitAI
Params8.2B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Parable Qwen3 4B Claude Fable 5
Qwen · AnkitAI
Params4B
Context40K
Q4_K_M2.5 GB
Reasoning
QW
Huihui Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
QW
Swift 1.5 Qwen3.8 27B
Qwen · ukisai
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningVision
QW
Qwen3-Vl-8B-Instruct
Qwen · unsloth
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO GGUF NInfer
Qwen · nerkyor
Params27.3B
Context256K
Smallest0.0 GB
GGUF
QW
Qwen Image 2.1 Turbo
Qwen · AtomicChat
Params7.12B
Context—
Smallest2.6 GB
GGUF
QW
Qwen3.5 9B
Qwen · bartowski
Params9.2B
Context256K
Q4_K_M6.2 GB
Vision
QW
Qwen2.5 Coder 14B Instruct AWQ
Qwen · Qwen
Params29B
Context128K
Q4_K_M18.0 GB
Coding
QW
Qwen3Vl 2b Instruct
Qwen · Qwen
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
QW
Qwen3.8 27B Uncensored
Qwen · azukivc
Params27.3B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.6 35B A3B
Qwen · bartowski
Params35.5B
Context256K
Q4_K_M22.3 GB
Vision
QW
Qwen3.8 27B Defiance Uncensored MTP
Qwen · ttindall
Params27.3B
Context—
Smallest0.9 GB
GGUF
QW
Qwen3 1.7B Instruct
Qwen · Qwen
Params1.72B
Context40K
Smallest1.8 GB
GGUF
QW
Qwen3.5-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.7 GB
Vision
QW
Qwen3.8 Flash Next Uncensored i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
ReasoningTool useVision

Keep browsing