Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 35B A3B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
QW
Qwen3 72B Embiggened
Qwen · bartowski
Params72.7B
Context40K
Q4_K_M47.4 GB
GGUF
QW
Ektome Qwen3 30B A3B PristinelyUncensored
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen3.5 24B A3B Claude Opus Gemini 3.1 Pro Reasoning Distilled Heretic
Qwen · mradermacher
Params24.5B
Context256K
Q4_K_M15.0 GB
Reasoning
QW
QwQ LCoT2 7B Instruct i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Reasoning
QW
Qwen2.5 0.5B
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Qwen3 Yoyo V3 42B A3B Thinking Total Recall
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
CodingReasoning
QW
Qwen3.5 9B Claude 4.6 HighIQ INSTRUCT HERETIC UNCENSORED
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Roleplay
QW
Qwen2.5 0.5B Instruct
Qwen · second-state
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Carnice Qwen3.6 MoE 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Qwen3 Reranker 4B
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
Embedding
QW
Models Qwen Qwen2.5 3B Instruct
Qwen · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen3.8 Flash Next Abliterated GSQ-RCO IQ3_XXS Calibrated Mixed Hybrid
Qwen · arytekSI
Params177B
Context256K
Smallest83.1 GB
GGUF
QW
Qwen3.8 27B MindMeld OneJev1.6
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
GrayLine Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
QW
Qwen3.5 27B Writer V2 Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.5 9B Kimi K3 Distilled
Qwen · somenetworktrouble
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
QW
RedSage Qwen3 8B Ins
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.5 4b Agentic Coder v4
Qwen · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
CodingVision
QW
Qwen3 Reranker 4B
Qwen · giladgd
Params4B
Context40K
Q4_K_M2.5 GB
Embedding
QW
jinaai/test-qwen25-coder-jina-code-embeddings-1.5b
Qwen · jinaai
Params1.54B
Context32K
Smallest0.4 GB
CodingEmbedding
QW
Qwen3 4B
Qwen · Aldaris
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Qwen3.5 9B Star Trek TNG DS9 Heretic Uncensored Thinking MAX NEOCODE
Qwen · DavidAU
Params8.95B
Context256K
Q4_K_M6.8 GB
ReasoningRoleplayVision
QW
Dolphin3.0 Qwen2.5 3B
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
CodingTool use
QW
Qwen3-Vl-4B-Thinking-1M
Qwen · unsloth
Params4B
Context977K
Q4_K_M2.5 GB
ReasoningVision
QW
Qwen3 coder REAP 25B A3B Rust
Qwen · Em-80
Params25B
Context256K
Q4_K_M15.1 GB
Coding
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · luoyumo
Params8.95B
Context256K
Q4_K_M6.8 GB
CodingReasoningRoleplay
QW
qwen3 coder next 80b redteam
Qwen · rafw007
Params79.7B
Context256K
Q4_K_M48.6 GB
CodingTool use
QW
Qwen3.5 40B RoughHouse Claude 4.6 Opus Polar Deckard Uncensored Heretic Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
QW
Qwen2.5 14B Instruct Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF

Keep browsing