Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 4B Abliterated
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
MiMo-V2.6-Distill-Qwen-9B
Qwen · ggml-org
Params8.95B
Context256K
Smallest9.5 GB
Vision
QW
Qwen3 14B Abliterated
Qwen · AIgotahole
Params14.8B
Context40K
Smallest8.6 GB
ReasoningTool use
QW
Qwen2.5 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
Reasoning
QW
Huihui Qwen3.5 9B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
QW
Qwen3.5 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Dongfangshuo Qwen3.8 27B NSFW
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
QW
Qwopus3.6 35B A3B v1
Qwen · Jackrong
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen3.5 9B The Defiant Fable DARK ROAST Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningRoleplay
QW
Qwen3.8 27B Heretic
Qwen · darrellbest
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
shisa v2.1 qwen3 8b
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Ingot 27B DFlash2
Qwen · dendriteholdings
Params1.92B
Context256K
Smallest2.1 GB
ReasoningTool use
QW
Qwen3.8 27B Med Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.5 122B A10B Abliterated
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
Vision
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
QW
Qwen3.8 27B Max Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3 4B Instruct 2507
Qwen · ggml-org
Params4B
Context256K
Smallest4.3 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · peculiar-ragdoll
Params447M
Context256K
Smallest14.1 GB
ReasoningVision
QW
Qwen3.5 27B WebNovel Writer Zh
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Swift Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M125.6 GB
ReasoningVision
QW
Qwen3 VL Embedding 8B
Qwen · VesNFF
Params7.6B
Context256K
Smallest6.2 GB
EmbeddingVision
QW
cerebras/Qwen3-Coder-REAP-25B-A3B
Qwen · bartowski
Params25B
Context256K
Q4_K_M15.2 GB
Coding
QW
Qwen3.5 9B Gemini 3.1 Pro Reasoning Distill
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningVision
QW
Qwen3 Swallow 8B RL v0.2
Qwen · mmnga-o
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
QW
sakura-8b-qwen3-v1.1
Qwen · SakuraLLM
Params8.2B
Context32K
Smallest4.6 GB
GGUF
QW
ThinkingCap Qwen3.6 27B abliterated MTP
Qwen · protoLabsAI
Params27.3B
Context—
Q4_K_M16.8 GB
Reasoning
QW
Agnes 3.0 Qwen
Qwen · bartowski
Params180B
Context1024K
Q4_K_M127.1 GB
ReasoningTool useVision
QW
Qwen3.5 4B GGUF shards
Qwen · Arki05
Params4B
Context—
Smallest0.0 GB
GGUF

Keep browsing