Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Qwen2.5 7B Instruct abliterated v2
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 Coder 32B Instruct Abliterated
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3.8 Flash Next FP4 Local Strata
Qwen · hardhant
Params51.2B
Context—
Smallest1.3 GB
QW
Qwen3.5 Text 9B NSFW RP RolePlay
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 8B Abliterated
Qwen · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
LFM2.5 8B A1B
Qwen · DavidAU
Params8.47B
Context125K
Smallest4.6 GB
QW
Qwen3.8 27B Heretic Ara 16GB VRAM IQ4 XS MTP
Qwen · Bucoid
Params27B
Context256K
Smallest13.7 GB
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5 0.8B
Qwen · bartowski
Params773M
Context256K
Q4_K_M0.6 GB
QW
Qwen3.5 9B Ultra Uncensored Heretic
Qwen · llmfan46
Params8.95B
Context256K
Q4_K_M5.5 GB
QW
Swift-1.5-Qwen3.8-27B-Uncensored-MTP
Qwen · IsValorum
Params27.3B
Context256K
Smallest14.2 GB
QW
Canary-Qwen 2.5B
Qwen · handy-computer
Params2.53B
Context—
Q4_K_M1.7 GB
QW
Qwen Image
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
QW
QwQ 32B
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Qwen2.5-Vl-3B-Instruct
Qwen · unsloth
Params3.09B
Context125K
Q4_K_M1.9 GB
QW
Dongfangshuo Qwen3.8 Flash Next NSFW
Qwen · dongfangshuo
Params177B
Context256K
Smallest69.7 GB
QW
Huihui Qwen3 30B A3B Instruct 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3 Coder Next Abliterated
Qwen · bartowski
Params79.7B
Context256K
Q4_K_M48.6 GB
QW
Qwen3 14B Abliterated
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3.5-27B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 9B Distill SLERP F451 Pro Writer Uncensored
Qwen · nuofang
Params1M
Context256K
Q4_K_M5.6 GB
QW
Qwen Image Edit Rapid AIO
Qwen · Phil2Sat
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Atomic Chat / Qwen3.5 4B DFlash
Qwen · AtomicChat
Params634M
Context256K
Smallest0.7 GB
QW
Models Qwen Qwen3 30B A3B Instruct 2507
Qwen · MaziyarPanahi
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.5 122B A10B
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
QW
Atomic Chat / Qwen3 4B DFlash
Qwen · AtomicChat
Params537M
Context40K
Smallest0.6 GB
QW
Qwen3 VL 8B Instruct
Qwen · bartowski
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Atomic Chat / Qwen3.5 9B DFlash
Qwen · AtomicChat
Params1.29B
Context256K
Smallest1.4 GB
QW
Qwen3.8 Flash Next Abliterated S1.5
Qwen · UltimateIntent
Params177B
Context256K
Q4_K_M119.1 GB
QW
Qwen3.6 35B A3B DFlash GGUF llama.cpp
Qwen · Alittlehammmer
Params386M
Context256K
Q4_K_M0.2 GB