Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Coder 1.5B Instruct heretic
Qwen · saidutta69
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingRoleplayTool use
QW
Qwen2.5 Coder 1.5B Unsensored DPO
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Qwen3.6 27B Omnimerge v4 MTP
Qwen · ManniX-ITA
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen2-Cantonese-7B-Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
WebWorld 14B
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.6 35B A3B heretic MTP IQ4 XS
Qwen · hermeticvm
Params35.5B
Context256K
Smallest19.2 GB
ReasoningTool use
QW
Qwen3.5 40B Holodeck Claude Deckard Picard Heretic
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
QW
Qwen2.5 14B_Uncencored_Instruct
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwen Image 2.1 Turbo Uncensored GGUF BF16
Qwen · KENIC-1
Params8.2B
Context256K
Smallest16.4 GB
CodingVision
QW
Qwen3 Coder 30B A3B Instruct
Qwen · DhruvalLabs
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Qwen 2.5 3b RP i1
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M2.1 GB
Roleplay
QW
Qwen Qwen3.8 27B GGUF IQ1 S
Qwen · sigmanih
Params27.3B
Context256K
Smallest0.1 GB
GGUF
QW
MiroThinker-v1.0-8B
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct GGUF
Qwen · simon5133
Params7.62B
Context128K
Q4_K_M9.4 GB
CodingTool use
QW
Qwen 2.5 3b Decensored
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
Qwen2.5 14B Instruct
Qwen · legraphista
Params14.8B
Context32K
Smallest3.6 GB
GGUF
QW
Huihui Qwen3 VL 2B Thinking Abliterated
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
ReasoningVision
QW
Qwen3 VL 32B Ultra Heretic Minimax H3
Qwen · eraiko
Params25.2B
Context256K
Smallest17.8 GB
Vision
QW
Qwen3 VL 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
QW
Huihui Qwen3 Omni 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
Vision
QW
QwenPaw Flash 9B heretic
Qwen · SC117
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool useVision
QW
Qwen3.5 9B RpRMax v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
QW
Qwen3.8 27B Omnimerge v6
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningVision
QW
Qwen3 8B 64k Josiefied Uncensored NEO Max
Qwen · DavidAU
Params8.19B
Context64K
Q4_K_M5.8 GB
ReasoningRoleplay
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
QW
VulnLLM-R-7B
Qwen · Mungert
Params7.6B
Context32K
Q4_K_M4.9 GB
CodingReasoning
QW
ISO42001 Qwen2.5 0.5B Edge
Qwen · sallani
Params494M
Context32K
Smallest1.0 GB
GGUF
QW
Qwen2.5 7B Instruct 1M Thinking Claude Gemini GPT5.2 DISTILL PaperWitch Heresy
Qwen · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
ReasoningRoleplay

Keep browsing