Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 235B A22B Abliterated
Qwen · mradermacher
Params235B
Context40K
Q4_K_M142.2 GB
GGUF
QW
Qwen3.8 Flash Next Heretic 2
Qwen · Deritak
Params128B
Context256K
Smallest91.5 GB
Vision
QW
Liberation Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
CaptchaKraken v1.2
Qwen · CaptchaKraken
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen2.5 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen3.8-Distilled-9B-NPU2
Qwen · Atomic-Germ
Params8.95B
Context256K
Smallest9.5 GB
ReasoningTool useVision
QW
Qwen3.5 0.8B Finetuned Lora Uncensored
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen2.5 0.5B Instruct heretic
Qwen · saidutta69
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Huihui Qwen3 VL 8B Instruct Abliterated
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen3 VL 4B Instruct Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
flux2 klein 4B uncensored text encoder
Qwen · Cordux
Params4B
Context—
Smallest2.4 GB
Coding
QW
Qwen3.5 4B Instruct
Qwen · openresearchtools
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3.8 27B NVFP4 MTP SSMFIX
Qwen · esatapedico
Params461M
Context256K
Smallest14.9 GB
Vision
QW
Qwen2-7B-Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
GGUF
QW
Qwen3.8 9B Distill Uncen Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
QW
Qwen3.8 27B NVFP4 MTP Q8attn
Qwen · utautako
Params461M
Context256K
Smallest17.4 GB
Vision
QW
Qwen2.5 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
DMind-3-mini
Qwen · Mungert
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
QW
Qwen Image 2.1 Uncensored
Qwen · daddysteven
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
QW
Qwen3.5 9B
Qwen · Smoffyy
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen3 Jan v1 256k Ctx 6B Brainstorm20x
Qwen · mradermacher
Params5.94B
Context256K
Q4_K_M3.6 GB
Coding
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwopus3.8 27B Flash
Qwen · Jackrong
Params461M
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
QW
Qwen2.5 Math 72B Instruct
Qwen · bartowski
Params72.7B
Context4K
Q4_K_M47.4 GB
GGUF
QW
Qwen3.5 9B The Defiant Fable DARK ROAST Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningRoleplay
QW
Qwen3 1.7B Coder Distilled SFT
Qwen · reaperdoesntknow
Params2.03B
Context40K
Q4_K_M1.3 GB
CodingReasoningTool use
QW
Millie 1.1 35B A3B Ternary
Qwen · llmsforall
Params34.7B
Context—
Smallest0.3 GB
GGUF
QW
Qwen3.5 14B A3B Claude 4.6 Opus Reasoning Distilled reap
Qwen · tvall43
Params14.1B
Context256K
Smallest8.8 GB
ReasoningVision
QW
Qwen3.6 27B PRISM PRO
Qwen · Ex0bit
Params27.3B
Context256K
Smallest13.7 GB
GGUF
QW
Josiefied Qwen3 8B Abliterated v1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF

Keep browsing