Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 7B Instruct Uncensored
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.8 27B EfficientThink VAL APEX I MiniPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Q4_K_M1.1 GB
CodingReasoningVision
QW
Qwen3.8-27B
Qwen · jrell
Params27.3B
Context256K
Smallest13.5 GB
GGUF
QW
Qwen3.5 9B GLM5.1 Distill v1
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
QW
ThinkingCap Qwen3.8 27B
Qwen · bottlecapai
Params27.3B
Context256K
Smallest14.3 GB
ReasoningVision
QW
Qwen3 30B A3B
Qwen · lmstudio-community
Params30.5B
Context32K
Q4_K_M18.6 GB
GGUF
QW
Qwen2.5 1.5B Instruct uncensored
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
QW
Qwen3 Next 80B A3B Thinking
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
Reasoning
QW
Qwen3.8 27B OBLITERATED
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.5 9B Uncensored
Qwen · LEONW24
Params9.65B
Context256K
Q4_K_M6.7 GB
GGUF
QW
Qwen2.5 VL 7B NSFW Caption V3
Qwen · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen2.5 7B Instruct Abliterated
Qwen · richardyoung
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.8 Flash Next Abliterated Uncensored
Qwen · cc1244578151
Params177B
Context256K
Smallest83.9 GB
CodingReasoningTool use
QW
Qwen3.8-27B
Qwen · Greatjedi
Params27B
Context256K
Smallest11.2 GB
GGUF
QW
Qwen3 Omni 30B A3B Captioner
Qwen · presencesw
Params30.5B
Context64K
Q4_K_M18.6 GB
Vision
QW
Qwen3.8 9B Distill Uncensored Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
QW
Huihui Qwen3 VL 8B Instruct Abliterated
Qwen · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen3-Vl-2B-Thinking
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
ReasoningVision
QW
Qwen3.8 Flash Next Uncensored IQ4XS NGQ4
Qwen · cygnal
Params177B
Context256K
Smallest98.4 GB
Vision
QW
Qwen3.5 4B heretic imatrix
Qwen · FadedRedStar
Params334M
Context256K
Q4_K_M2.7 GB
CodingVision
QW
Qwen3-235B-A22B-Instruct-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
GGUF
QW
Qwen3.8 27B abliterated MTP
Qwen · hotdogs
Params27B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen2.5 VL 3B Instruct
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
Qwen3.5 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest13.3 GB
Vision
QW
Qwen3 32B Uncensored
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen3 VL 8B Heretic Stable
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
qwen2.5-32b-instruct
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
QW
Qwen3 8B Heretic
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes Final NVFP4
Qwen · jan1k
Params34.7B
Context256K
Smallest21.1 GB
Tool useVision
QW
Qwen3.5 9B Coder
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningTool use

Keep browsing