Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 8B Base
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.5 35B A3B Uncensored Heretic v2 Native MTP Preserved
Qwen · llmfan46
Params447M
Context256K
Q4_K_M21.8 GB
Vision
QW
Qwen3.5 9B Claude 4.6 Opus Deckard V4.2 Uncensored Heretic Thinking
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplay
QW
Qwen3.8 4B Distill Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
QW
Qwen2.5 0.5B Instruct 3MPER0RR Abliterated
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
CoPaw Flash 9B
Qwen · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
QW
Qwen3.5 35B A3B Heretic Opus 4.6 Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Qwen3 42B A3B Spock Brutal Recall Instruct
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoning
QW
Qwen3 42B A3B 2507 Thinking Abliterated Uncensored TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoning
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · shennguyen
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningVision
QW
Qwen_Qwen3 4B Thinking 2507
Qwen · Alcoft
Params4B
Context256K
Q4_K_M2.4 GB
Reasoning
QW
Qwen2.5 7B Instruct 1M Heretic
Qwen · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
Roleplay
QW
ari paraphraser 1.5b
Qwen · sriyuth
Params1.54B
Context32K
Smallest1.0 GB
GGUF
QW
Qwen3 VL 32B Gemini Heretic Uncensored Thinking
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningRoleplayVision
QW
Qwen2.5 Coder 0.5B Instruct heretic
Qwen · saidutta69
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 1million Ctx
Qwen · mradermacher
Params42.4B
Context1024K
Q4_K_M25.7 GB
CodingReasoning
QW
Qwen3.8 27B AEON ULTIMATE UNCENSORED
Qwen · vcruz305
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
nsfwcaption qwen3 vl 8b v3
Qwen · GitMylo
Params8.2B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen2.5 Coder 14B Instruct Uncensored
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
QW
Qwen3.5 4B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningRoleplay
QW
qwen3.5 35b a3b compacted
Qwen · cahlen
Params23.5B
Context256K
Q4_K_M14.4 GB
GGUF
QW
PocketWeights Qwen2.5 14B Coder Creative
Qwen · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
Coding
QW
Qwen2 VL 2B Instruct Abliterated
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
Vision
QW
deepsek qwen1.5 vpn
Qwen · tsss1
Params1.78B
Context128K
Smallest1.9 GB
GGUF
QW
Qwen3 53B A3B TOTAL RECALL v1.4 128k
Qwen · mradermacher
Params53B
Context128K
Q4_K_M32.1 GB
CodingReasoning
QW
Huihui Qwen3 Coder 30B A3B Instruct Abliterated
Qwen · AI-conn
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
QW
Qwen3 Reranker 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Embedding
QW
Qwen.Qwen2.5 VL 3B Instruct
Qwen · DevQuasar-6
Params669M
Context125K
Q4_K_M1.9 GB
Vision
QW
Candid 3.5
Qwen · Verdugie
Params26.9B
Context256K
Q4_K_M16.9 GB
Reasoning

Keep browsing