Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Qwen3.8 Flash Next REAP 288 Bf16
Qwen · sh0wie
Params124B
Context256K
Q4_K_M83.8 GB
QW
Qwen3 0.6B
Qwen · bartowski
Params752M
Context32K
Q4_K_M0.5 GB
QW
Qwen3.8 Flash Next IQ2_XXS imatrix trunk, padded Q2_K down, MTP
Qwen · antirez
Params188B
Context256K
Smallest147.2 GB
QW
Qwen3.5 4B
Qwen · SoAIHQ
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen3.5-4B
Qwen · unsloth
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen3.8 27B Jumbo Fusion IQ 747 900 Turbo Brilliance 50X Reasoning Instruct NEO MAX MTP
Qwen · DavidAU
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 30B A3B
Qwen · Qwen
Params30.5B
Context40K
Q4_K_M18.6 GB
QW
nl2sh 1.5b Q4 K M
Qwen · ThorOdinson246
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3.5 0.8B Artemis
Qwen · turintech
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · lmstudio-community
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M119.6 GB
QW
Qwen3.8 27B Uncensored
Qwen · orcarouter
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 35B A3B Distill
Qwen · IsValorum
Params34.7B
Context256K
Smallest1.2 GB
QW
Swift 1.5 Qwen3.8 27B Uncensored Dynamic MTP
Qwen · ajgazin
Params28B
Context256K
Smallest8.8 GB
QW
Qwen3 4B Instruct 2507
Qwen · lmstudio-community
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen3-Vl-2B-Instruct
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen2.5 Coder 3B Instruct AWQ
Qwen · Qwen
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
Qwen3.8 Flash Next Abliterated Uncensored Turbo Brilliance 50x Reasoning Instruct GSQ RCO
Qwen · DavidAU
Params177B
Context256K
Smallest83.9 GB
QW
Qwen3.8 27B Humanlike Chat
Qwen · LessThanThreeAI
Params26.9B
Context256K
Q4_K_M16.6 GB
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen2.5 Omni 3B
Qwen · ggml-org
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
Qwen3.6-27B
Qwen · ggml-org
Params26.9B
Context256K
Q4_K_M19.1 GB
QW
Huihui Qwen3 Coder 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.5-9B
Qwen · unsloth
Params9.2B
Context256K
Q4_K_M5.9 GB
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved
Qwen · llmfan46
Params35.5B
Context256K
Q4_K_M21.8 GB
QW
Huihui Qwen3.8 Flash Next Abliterated
Qwen · mradermacher
Params177B
Context256K
Smallest80.4 GB
QW
Qwen3.5 9B Abliterated
Qwen · lukey03
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2.5 VL 7B Instruct
Qwen · ggml-org
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.8 Flash Next Uncensored Gufo Q4Mix
Qwen · vmlinux
Params177B
Context256K
Smallest109.8 GB