Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled
Qwen · RomanOneAndFun
Params35.5B
Context256K
Smallest29.4 GB
Reasoning
QW
Qwen3 Uncensored TextEncoders FLUX Klein Z Image Turbo
Qwen · wazimondo
Params4.02B
Context40K
Smallest4.3 GB
Coding
QW
dgpl linux assistant 0.8b
Qwen · dgpl
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen3 VL 8B NSFW Caption V4.5
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen2-7B-Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3 1.7B Jailbreak Reasoning
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
QW
I2S Qwen3 8B Confidence
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen2.5 Lumen 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
QW
Qwen3.5 9B heretic imatrix
Qwen · FadedRedStar
Params456M
Context256K
Q4_K_M5.6 GB
CodingVision
QW
Qwen3 14b Heretic v2
Qwen · FoPlayerBlock
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.5 9B Polaris HighIQ THINKING
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplay
QW
Qwen2.5 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Bharat Tiny LLM v3
Qwen · eulogik
Params1.72B
Context32K
Q4_K_M1.1 GB
Tool use
QW
Qwen3.5 9B heretic
Qwen · FadedRedStar
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingVision
QW
Qwen2.5 72b RP Ink
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Roleplay
QW
Qwen3 32B LoRA ECHO KK GRPO
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen2.5 Godzilla Coder 51B 128k
Qwen · mradermacher
Params51B
Context128K
Q4_K_M30.7 GB
Coding
QW
Qwen3 Coder 30B A3B Instruct
Qwen · n00b001
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
UwU Qwen3.5 27B v0.1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplay
QW
Qwen3.5 9B DFlash
Qwen · Anbeeld
Params1.29B
Context256K
Q4_K_M0.8 GB
CodingEmbedding
QW
Qwen2.5 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.5 2B GPT 5.1 HighIQ INSTRUCT
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
Reasoning
QW
Qwen3 5 2b
Qwen · diodel
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
QW
godot qwen2.5 coder 7b instruct bnb 4bit
Qwen · bekoozkan
Params7.6B
Context32K
Q4_K_M4.7 GB
Coding
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Qwen3 Esper3 Reasoning CODER Instruct 12B Brainstorm20x
Qwen · mradermacher
Params11.9B
Context40K
Q4_K_M7.2 GB
CodingReasoning
QW
Qwen3 VL 12B Instruct Brainstorm20x
Qwen · mradermacher
Params11.9B
Context256K
Q4_K_M7.2 GB
CodingVision
QW
Qwen3.8-27B-DFlash2
Qwen · HermiHg
Params1.92B
Context256K
Smallest0.6 GB
GGUF
QW
MLXFW Qwen3.8 Flash Next Heretic Q8 0
Qwen · the-shop
Params177B
Context256K
Smallest4.1 GB
Vision
QW
Qwen3 30B A3B Instruct 2507 REAM Heretic
Qwen · mradermacher
Params23.3B
Context256K
Q4_K_M14.2 GB
GGUF

Keep browsing