Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Qwen3 DND Jan v1 256k Ctx Brainstorm40x 8B
Qwen · mradermacher
Params7.66B
Context256K
Q4_K_M4.7 GB
QW
Qwen3 42B A3B Stranger Thoughts Deep20x Abliterated Uncensored
Qwen · mradermacher
Params42.4B
Context40K
Q4_K_M25.7 GB
QW
Replete LLM V2.5 Qwen 7b
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.8 Flash Next NVFP4
Qwen · magnitudedev
Params177B
Context256K
Smallest127.8 GB
QW
Qwen3.5-9B
Qwen · EcoAI-Lab
Params9.2B
Context256K
Smallest3.9 GB
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
typecastlm qwen3.5 3.8b
Qwen · mihailgribov
Params3.76B
Context256K
Smallest4.0 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes
Qwen · yuhanb
Params34.7B
Context256K
Smallest12.9 GB
QW
Qwen3.8 27B Uncensored FP8
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Continuum
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.6 Fallen Fabulist 35B A3B Heretic
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3-TTS-12Hz-0.6B-CustomVoice
Qwen · sakasegawa
Params1.02B
Context—
Smallest0.8 GB
QW
qwen3 asr 1.7b ja anime
Qwen · cstr
Params2.35B
Context—
Smallest1.5 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
QW
Qwen3 Esper3 Reasoning Instruct 6B Brainstorm20x Enhanced E32
Qwen · mradermacher
Params5.94B
Context40K
Q4_K_M3.6 GB
QW
Qwen3.6 27B redteam v5
Qwen · RedTeamLab
Params27B
Context256K
Q4_K_M2.0 GB
QW
Qwen3.8-27B
Qwen · BoldingBuilds
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Humberto16
Params27B
Context256K
Q4_K_M18.0 GB
QW
Qwen3 30B A1.5B 64K High Speed NEO Imatrix MAX
Qwen · DavidAU
Params30.5B
Context64K
Q4_K_M18.6 GB
QW
Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
GrayLine Qwen3 14B
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3Vl 2b Thinking
Qwen · Qwen
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context4K
Q4_K_M1.0 GB
QW
Qwen2.5 VL 72B Instruct Heretic
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
QW
Qwen3.8 27B Ultra Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen2.5 Coder 32B Instruct AWQ
Qwen · EasierAI
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Qwen3 VL 8B Heretic Stable
Qwen · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3.5 0.8B GPT 6 Astra Luna Fable 5.1 Opus 5.5 distill
Qwen · 0xSojalSec
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen2.5 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB