Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 Flash Next REAP 288 Bf16
Qwen · sh0wie
Params124B
Context256K
Q4_K_M83.8 GB
GGUF
QW
Qwen3 0.6B
Qwen · bartowski
Params752M
Context32K
Q4_K_M0.5 GB
GGUF
QW
Qwen3.8 Flash Next IQ2_XXS imatrix trunk, padded Q2_K down, MTP
Qwen · antirez
Params188B
Context256K
Smallest147.2 GB
GGUF
QW
Qwen3.5 4B
Qwen · SoAIHQ
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
QW
Qwen3.5-4B
Qwen · unsloth
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
QW
Qwen3.8 27B Jumbo Fusion IQ 747 900 Turbo Brilliance 50X Reasoning Instruct NEO MAX MTP
Qwen · DavidAU
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningRoleplay
QW
Qwen3 30B A3B
Qwen · Qwen
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
QW
nl2sh 1.5b Q4 K M
Qwen · ThorOdinson246
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Qwen3.5 0.8B Artemis
Qwen · turintech
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen3 Coder 30B A3B Instruct
Qwen · lmstudio-community
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M119.6 GB
Vision
QW
Qwen3.8 27B Uncensored
Qwen · orcarouter
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
QW
Qwen3.8 35B A3B Distill
Qwen · IsValorum
Params34.7B
Context256K
Smallest1.2 GB
ReasoningTool useVision
QW
Swift 1.5 Qwen3.8 27B Uncensored Dynamic MTP
Qwen · ajgazin
Params28B
Context256K
Smallest8.8 GB
Vision
QW
Qwen3 4B Instruct 2507
Qwen · lmstudio-community
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
Qwen3-Vl-2B-Instruct
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
QW
Qwen2.5 Coder 3B Instruct AWQ
Qwen · Qwen
Params3.4B
Context32K
Q4_K_M2.1 GB
Coding
QW
Qwen3.8 Flash Next Abliterated Uncensored Turbo Brilliance 50x Reasoning Instruct GSQ RCO
Qwen · DavidAU
Params177B
Context256K
Smallest83.9 GB
CodingReasoningVision
QW
Qwen3.8 27B Humanlike Chat
Qwen · LessThanThreeAI
Params26.9B
Context256K
Q4_K_M16.6 GB
ReasoningRoleplayTool use
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen2.5 Omni 3B
Qwen · ggml-org
Params3.4B
Context32K
Q4_K_M2.1 GB
Vision
QW
Qwen3.6-27B
Qwen · ggml-org
Params26.9B
Context256K
Q4_K_M19.1 GB
Vision
QW
Huihui Qwen3 Coder 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Qwen3.5-9B
Qwen · unsloth
Params9.2B
Context256K
Q4_K_M5.9 GB
Vision
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved
Qwen · llmfan46
Params35.5B
Context256K
Q4_K_M21.8 GB
Vision
QW
Huihui Qwen3.8 Flash Next Abliterated
Qwen · mradermacher
Params177B
Context256K
Smallest80.4 GB
Vision
QW
Qwen3.5 9B Abliterated
Qwen · lukey03
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen2.5 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen2.5 VL 7B Instruct
Qwen · ggml-org
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3.8 Flash Next Uncensored Gufo Q4Mix
Qwen · vmlinux
Params177B
Context256K
Smallest109.8 GB
Vision

Keep browsing