Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.6-35B-A3B
Qwen · TokenTinkerer
Params34.7B
Context256K
Q4_K_M0.6 GB
ReasoningTool use
QW
Ternary Bonsai 2 27B gguf dev
Qwen · prism-ml
Params27B
Context256K
Smallest7.6 GB
GGUF
QW
Dolphin3.0 Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
QW
Qwen2.5 32B AGI
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
imajev 9b
Qwen · mindchain
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen3 4B
Qwen · ggml-org
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Huihui Qwen3.5 2B Abliterated
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Qwen3.8 Flash Next i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
GGUF
QW
Qwen3 VL 4B Instruct
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
QW
Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3 4B Abliterated
Qwen · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Qwopus3 5 9B Coder Flash Test2 MTP HF
Qwen · Jackrong
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningTool use
QW
Qwen3.8 35B A3B Distill
Qwen · IsValorum
Params34.7B
Context256K
Smallest1.2 GB
ReasoningTool useVision
QW
Qwen3.8-27B
Qwen · kingjones777
Params26.9B
Context256K
Smallest1.7 GB
ReasoningTool useVision
QW
Qwen3.8 27B Abliterated
Qwen · prithivMLmods
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
QW
T-Search-Qwen3.6-35B-A3B
Qwen · t-tech
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
QW
Qwen Image 2.1
Qwen · AlperKTS
Params7.12B
Context—
Smallest4.9 GB
GGUF
QW
Qwen2.5 3B Instruct Uncensored
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen3.6 35B A3B MTP APEX I MiniPlus V2.1 Abliterated
Qwen · IsValorum
Params34.7B
Context256K
Smallest1.2 GB
ReasoningTool useVision
QW
Qwen3.5-9B
Qwen · jc-builds
Params8.95B
Context256K
Q4_K_M5.7 GB
Vision
QW
Qwen3-Coder-30B-A3B-Instruct-1M
Qwen · unsloth
Params30.5B
Context1024K
Q4_K_M18.6 GB
Coding
QW
Huihui Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Huihui Qwen3.6 35B A3B abliterated
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
RoleplayVision
QW
Qwen3 8B
Qwen · Aldaris
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Huihui Qwen3.8 27B Coder390 EfficientThink Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Coding
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
QW
Qwen3.6 12B IQ Ultra Heretic Uncensored Thinking V2 Hightop
Qwen · KevinJK51
Params11.7B
Context256K
Q4_K_M7.3 GB
Reasoning
QW
Qwen3.8 27B Uncensored
Qwen · xCloudinfo
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen1.5-0.5B-Chat-AWQ-fp16
Qwen · Qwen
Params620M
Context32K
Q4_K_M0.4 GB
GGUF

Keep browsing