Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3 4b Deslop v4
Qwen · erikkannike
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
Qwen2-0.5B-Instruct
Qwen · legraphista
Params494M
Context32K
Smallest0.3 GB
GGUF
QW
Qwen2.5 Coder 3B
Qwen · ggml-org
Params3.09B
Context32K
Smallest3.3 GB
Coding
QW
Qwen3-Vl-2B-Instruct-1M
Qwen · unsloth
Params1.72B
Context977K
Q4_K_M1.1 GB
Vision
QW
hermes qwen3.5 35b a3b
Qwen · DJLougen
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool use
QW
Qwen3.8 27B DFlash2
Qwen · Anbeeld
Params1.92B
Context256K
Q4_K_M1.1 GB
GGUF
QW
Qwen3.5-397B-A17B
Qwen · unsloth
Params403B
Context256K
Q4_K_M248.8 GB
Vision
QW
Qwen3.5 4B MultiDistill 3xMerge UNCENSORED Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningVision
QW
Sakura Qwen Image 2.1 PE I2I Uncensored
Qwen · webmp3
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen2.5 Coder 1.5B Shellsmith
Qwen · ajayk007
Params1.54B
Context32K
Smallest3.1 GB
Coding
QW
Qwen2.5 Coder 7B
Qwen · ggml-org
Params7.62B
Context32K
Smallest8.1 GB
Coding
QW
Qwen3.8 Flash Next MTP
Qwen · quimmedes
Params3.88B
Context256K
Smallest1.2 GB
GGUF
QW
calme 2.1 qwen2 72b
Qwen · MaziyarPanahi
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen3 16B A3B
Qwen · bartowski
Params16B
Context40K
Q4_K_M9.8 GB
GGUF
QW
Qwen3.5-2B
Qwen · trubisky
Params1.88B
Context256K
Smallest0.7 GB
GGUF
QW
RavenX CyberAgent v6.2 Experimental
Qwen · deadbydawn101
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool use
QW
Qwen3 14B RefusalDirection ThinkingAware
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning
QW
GPT 5 Distill Qwen3 4B Instruct
Qwen · Jackrong
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
Qwen3.5 4B Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
QW
Qwen3 VL 8B Thinking
Qwen · bartowski
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningVision
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen3 The Josiefied Omega Directive 22B Uncensored Abliterated
Qwen · mradermacher
Params22B
Context40K
Q4_K_M13.3 GB
Roleplay
QW
Qwen2.5 VL 3B uncensored bughunter v9
Qwen · mmp2055
Params3.1B
Context125K
Q4_K_M1.9 GB
Tool useVision
QW
MiMo V2.6 Distill Qwen 9B Ablit
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool use
QW
open text detector qwen36 35b a3b oct10
Qwen · woog
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3-8B-abliterated
Qwen · Mungert
Params8.2B
Context40K
Q4_K_M5.2 GB
GGUF
QW
Qwen3 6B Hivemind Instruct Heretic Abliterated Uncensored NEO Imatrix
Qwen · DavidAU
Params5.94B
Context256K
Q4_K_M3.6 GB
Roleplay
QW
Qwen3.6 35B A3B DFlash
Qwen · Anbeeld
Params386M
Context256K
Q4_K_M0.2 GB
CodingEmbedding
QW
qwen3 tts voices
Qwen · cstr
Params—
Context—
Smallest0.0 GB
GGUF

Keep browsing