Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-ASR 0.6B
Qwen · handy-computer
Params782M
Context—
Q4_K_M0.6 GB
GGUF
QW
Qwen3.6 35B A3B NVFP4 MTP
Qwen · michaelw9999
Params35.5B
Context256K
Smallest20.4 GB
GGUF
QW
Qwen_Qwen3.5 4B
Qwen · lmstudio-community
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen2.5 14B Instruct
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Swift 1.5 Qwen3.8 Flash Next
Qwen · ukisai
Params177B
Context256K
Q4_K_M119.6 GB
ReasoningVision
QW
Qwen3.6 27B NVFP4 MTP
Qwen · michaelw9999
Params27.3B
Context256K
Smallest16.2 GB
GGUF
QW
Holo 3.1 35B A3B
Qwen · Hcompany
Params34.7B
Context256K
Q4_K_M21.3 GB
Vision
QW
Qwen3 Embedding 0.6b
Qwen · Qwen
Params596M
Context32K
Smallest0.6 GB
Embedding
QW
Qwen_Qwen3.6 35B A3B
Qwen · lmstudio-community
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.8 27B Uncensored
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
ReasoningTool useVision
QW
Qwen Qwen3.6 27B
Qwen · batiai
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3-Coder-Next
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
Coding
QW
Qwen Image Edit 2509
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
QW
Qwen3-0.6B
Qwen · unsloth
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
QW
Qwen3 4B
Qwen · bartowski
Params4B
Context32K
Q4_K_M2.5 GB
GGUF
QW
Qwen2.5 Omni 7B
Qwen · ggml-org
Params7.6B
Context32K
Q4_K_M4.7 GB
Vision
QW
Qwen3-8B
Qwen · unsloth
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · ggml-org
Params1.9B
Context256K
Q4_K_M20.4 GB
Vision
QW
Qwen3 1.7B
Qwen · ggml-org
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
QW
Qwen3.5-122B-A10B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params122B
Context256K
Q4_K_M74.2 GB
Vision
QW
Qwen2.5 VL 3B Instruct
Qwen · ggml-org
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
Huihui Qwen3.8 Flash Next abliterated i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
GGUF
QW
Qwen3.5 4B
Qwen · bartowski
Params4.33B
Context256K
Q4_K_M3.0 GB
Vision
QW
Qwen Image 2.1
Qwen · leejet
Params7.12B
Context—
Smallest2.6 GB
GGUF
QW
Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen Image
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
QW
Qwen3 Reranker 0.6B
Qwen · ggml-org
Params596M
Context40K
Smallest0.6 GB
Embedding
QW
Qwen Image 2.1 Text Encoder Heretic
Qwen · pottokao
Params8.2B
Context256K
Q4_K_M5.0 GB
CodingVision
QW
Qwen3 32B Awq Compatible Instruct
Qwen · Qwen
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
GGUF

Keep browsing