Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 TTS 12Hz 1.7B Base
Qwen · ggml-org
Params1.73B
Context32K
Q4_K_M1.0 GB
Vision
QW
Qwen3.8 27B TWIN TURBO Fable Cold Fusion 709 ULTRA HERETIC Uncensored NM DAU NEO MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3 VL 32B Instruct ultra uncensored heretic H3
Qwen · nif0
Params25.2B
Context256K
Q4_K_M14.9 GB
Vision
QW
Qwen Image 2.1 PE T2I Heretic
Qwen · pottokao
Params8.95B
Context256K
Q4_K_M5.9 GB
GGUF
QW
Qwen3.5 35B A3B
Qwen · bartowski
Params35.5B
Context256K
Q4_K_M22.3 GB
Vision
QW
models--Qwen--Qwen2-7B-Instruct
Qwen · MaziyarPanahi
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3 ASR 1.7B
Qwen · ggml-org
Params2.03B
Context64K
Smallest2.2 GB
Vision
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Qwen2.5 Coder 14B Instruct Abliterated
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
QW
Qwen3.8 Flash Next
Qwen · agentionai
Params177B
Context256K
Q4_K_M94.5 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct
Qwen · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
QW
Models Qwen QwQ 32B
Qwen · MaziyarPanahi
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
QW
Qwen3.6-27B-Uncensored-HauhauCS-Balanced
Qwen · HauhauCS
Params27B
Context256K
Smallest10.0 GB
Vision
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Text_Encoder
Qwen · pottokao
Params26.5B
Context256K
Smallest11.5 GB
CodingVision
QW
Qwen3.5 4B Claude 4.6 Opus Reasoning Distilled
Qwen · Jackrong
Params4.2B
Context256K
Q4_K_M2.7 GB
ReasoningVision
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Dongfangshuo Qwen3.8 27B NSFW v4
Qwen · dongfangshuo
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
QW
Qwen Image 2.1
Qwen · Abiray
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
QW
Qwen3 8B
Qwen · lmstudio-community
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.8 9B Distill Uncensored Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
QW
Huihui Qwen3 VL 4B Instruct Abliterated
Qwen · noctrex
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
Qwen Image 2.1 PE T2I
Qwen · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Huihui Qwen3.8 27B Coder390 EfficientThink abliterated
Qwen · huihui-ai
Params7M
Context—
Smallest0.0 GB
GGUF
QW
LFM2.5 2.6B
Qwen · DavidAU
Params2.7B
Context128K
Smallest1.5 GB
Reasoning
QW
Qwen3.8 Flash Next GSQ RCO
Qwen · pfeifferj
Params125B
Context256K
Smallest29.5 GB
Vision
QW
Qwen Image 2.1 PE MTP
Qwen · mozophe
Params9.2B
Context256K
Q4_K_M6.0 GB
Vision
QW
Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B Ablitrated
Qwen · Hikari07jp
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool useVision
QW
Qwen3 Coder Next
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
Coding

Keep browsing