Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 DND Jan v1 256k Ctx Brainstorm40x 8B
Qwen · mradermacher
Params7.66B
Context256K
Q4_K_M4.7 GB
CodingReasoning
QW
Qwen3 42B A3B Stranger Thoughts Deep20x Abliterated Uncensored
Qwen · mradermacher
Params42.4B
Context40K
Q4_K_M25.7 GB
ReasoningRoleplay
QW
Replete LLM V2.5 Qwen 7b
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.8 Flash Next NVFP4
Qwen · magnitudedev
Params177B
Context256K
Smallest127.8 GB
ReasoningTool useVision
QW
Qwen3.5-9B
Qwen · EcoAI-Lab
Params9.2B
Context256K
Smallest3.9 GB
GGUF
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
QW
typecastlm qwen3.5 3.8b
Qwen · mihailgribov
Params3.76B
Context256K
Smallest4.0 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes
Qwen · yuhanb
Params34.7B
Context256K
Smallest12.9 GB
Tool useVision
QW
Qwen3.8 27B Uncensored FP8
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.8 27B Continuum
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplay
QW
Qwen3.6 Fallen Fabulist 35B A3B Heretic
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Roleplay
QW
Qwen3-TTS-12Hz-0.6B-CustomVoice
Qwen · sakasegawa
Params1.02B
Context—
Smallest0.8 GB
GGUF
QW
qwen3 asr 1.7b ja anime
Qwen · cstr
Params2.35B
Context—
Smallest1.5 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
Coding
QW
Qwen3 Esper3 Reasoning Instruct 6B Brainstorm20x Enhanced E32
Qwen · mradermacher
Params5.94B
Context40K
Q4_K_M3.6 GB
CodingReasoning
QW
Qwen3.6 27B redteam v5
Qwen · RedTeamLab
Params27B
Context256K
Q4_K_M2.0 GB
GGUF
QW
Qwen3.8-27B
Qwen · BoldingBuilds
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Humberto16
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3 30B A1.5B 64K High Speed NEO Imatrix MAX
Qwen · DavidAU
Params30.5B
Context64K
Q4_K_M18.6 GB
ReasoningRoleplayTool use
QW
Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
QW
GrayLine Qwen3 14B
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning
QW
Qwen3 Coder 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Qwen3Vl 2b Thinking
Qwen · Qwen
Params1.72B
Context256K
Q4_K_M1.1 GB
ReasoningVision
QW
Qwen2.5 Math 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
QW
Qwen2.5 VL 72B Instruct Heretic
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
CodingVision
QW
Qwen3.8 27B Ultra Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct AWQ
Qwen · EasierAI
Params32.8B
Context128K
Q4_K_M19.9 GB
Coding
QW
Qwen3 VL 8B Heretic Stable
Qwen · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen3.5 0.8B GPT 6 Astra Luna Fable 5.1 Opus 5.5 distill
Qwen · 0xSojalSec
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
QW
Qwen2.5 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use

Keep browsing