Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 VL 8B Thinking Abliterated
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
QW
Qwen2-7B-Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 VL 7B Instruct Abliterated
Qwen · decerto
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen2.5 Coder 32B Instruct
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QW
Huihui Qwen3.8 27b
Qwen · kisaragi-mochi
Params27.3B
Context256K
Smallest19.5 GB
ReasoningTool use
QW
Qwen3.5 Queen 27B
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
RoleplayVision
QW
Chimera Qwen3.8 27B Cyber v1
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
QW
Whittle Qwen 3.8 35B A3B
Qwen · el4
Params35.5B
Context256K
Smallest17.3 GB
Reasoning
QW
Qwen Image 2.1 PE T2I
Qwen · Moseyanling
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen3.5 27B Marvin DPO V2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
QW
Qwen2 VL 72B Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Vision
QW
bu-30b-a3b-preview
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
Vision
QW
Qwen3.5 4B Vision
Qwen · bjivanovich
Params4.2B
Context256K
Q4_K_M2.7 GB
Vision
QW
Veloxy Flash 15B
Qwen · zveloxy
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
QW
Qwen3 8B Thinking RoleVerse SFT DPO
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningRoleplayTool use
QW
Qwen2.5 14B Gutenberg Instruct Slerpeno
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
EgoActor 8b Qwen3VL
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · duyntnet
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Vikhr-Qwen-2.5-1.5B-Instruct
Qwen · Vikhrmodels
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3.5 9B Neo
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
QW
Qwen3-Reranker-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.5 GB
Embedding
QW
Qwen3 4B Thinking 2507 MiMo V2 Flash Distill
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
QW
Community Blend Qwen3 8b
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
QwenDGAF 0.6B
Qwen · hecan3d
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
QW
Qwen3.8 27B Abliterated SFT
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen2.5 2X11B CODER Dueling Wolverines V2 28B
Qwen · mradermacher
Params28B
Context32K
Q4_K_M17.0 GB
CodingTool use
QW
Qwen3.8 27B OBLITERATUS Advanced
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.5 21B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
CodingReasoningRoleplay
QW
MiMo V2.6 Distill Qwen 9B
Qwen · wepiqx
Params8.95B
Context256K
Smallest4.7 GB
GGUF
QW
Qwen3 30B A3B Instruct 2507
Qwen · ubergarm
Params30.5B
Context256K
Smallest8.1 GB
GGUF

Keep browsing