Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Swift1.5 Qwen3.8 Flash Next
Qwen · tirex2001
Params56.1B
Context256K
Smallest60.4 GB
GGUF
QW
DAU_Qwen3.6_27B_H2_FT
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
QW
Qwen3.8 27B Heretic Dynamic
Qwen · ajgazin
Params27.3B
Context256K
Smallest17.6 GB
Vision
QW
Gliese Qwen3.5 9B Abliterated Caption
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
QW
RWKV6QwQ 32B Final 250307
Qwen · mradermacher
Params34.9B
Context1024K
Q4_K_M22.8 GB
Reasoning
QW
Qwen3 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen3.8 27B TurboFCFusion CyberSec
Qwen · bbkdevops
Params27.3B
Context256K
Smallest17.8 GB
GGUF
QW
Qwen3.5 27B Claude 4.6 OS INSTRUCT
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
QW
Qwen3.5 9B Heretic ARA Refusals5
Qwen · NullpoLab
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B
Qwen · Myric
Params35.5B
Context256K
Smallest14.4 GB
GGUF
QW
Qwen3.6 27B Tachibana Agent
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
CodingReasoning
QW
Qwen3.5 4B Qwensploit CyberSecurity
Qwen · xtools-at
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
QW
Qwen2.5 1.5B Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
GGUF
QW
Qwen3 33B A3B Quad Mind
Qwen · mradermacher
Params33B
Context32K
Q4_K_M20.1 GB
ReasoningRoleplay
QW
Qwen3.5-4B
Qwen · Fix-AI
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
QW
Qwen2.5 1.5B Dare_Linear Merge
Qwen · pravdin
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3.5-4B
Qwen · jc-builds
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
QW
Huihui Qwen3 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
QW
Qwen3 4B Gemini TripleX High Reasoning Thinking Heretic Uncensored
Qwen · DavidAU
Params4B
Context256K
Smallest4.3 GB
ReasoningRoleplay
QW
qwen2.5 vl 7b it
Qwen · chatpig
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
ThinkingCap Qwen3.8 27B MIX
Qwen · vmarcelo
Params27.3B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.5 4B Deckard HERETIC UNCENSORED Thinking
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningRoleplay
QW
Qwen2.5 Coder 14B Instruct
Qwen · itlwas
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
QW
Qwen3.5-9B
Qwen · a4lg
Params2.28B
Context256K
Q4_K_M1.6 GB
GGUF
QW
Qwen3.8 Flash Next Heretic Hybrid q4lean5
Qwen · the-shop
Params177B
Context256K
Smallest4.1 GB
Vision
QW
Qwen3.8 27B ScientificBM
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.5 9B Theseus
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningRoleplay
QW
Qwen2.5 0.5B
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen3.5 27B Writer V2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.5 4B Artemis
Qwen · turintech
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision

Keep browsing