Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 9b Triple Loop Fase2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Heretic Qwen3.5 4b
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen3 4B Base
Qwen · mradermacher
Params4B
Context32K
Q4_K_M2.5 GB
GGUF
QW
Qwen_Qwen3 VL 2B Instruct
Qwen · lmstudio-community
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
QW
MARTHA LXVII.8B QWEN 3.5 3.6 prune 9b 3.6 base
Qwen · ZERO-POINT-AI
Params8.1B
Context256K
Q4_K_M5.1 GB
RoleplayVision
QW
Bella Bartender Qwen3 1.7b
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
QW
Models Qwen Qwen2 Math 7B Instruct
Qwen · MaziyarPanahi
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.8 27B full Uncensored
Qwen · 0xSojalSec
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.8 27B TURBO MTP
Qwen · nimbowz
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Whittle Qwen 3.8 45B A3B
Qwen · logic65
Params45.1B
Context256K
Q4_K_M27.1 GB
CodingReasoningTool use
QW
Qwen2.5 Coder 14B n8n Workflow Generator
Qwen · evansanih
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
QW
Radha 9B
Qwen · Advisio
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
QW
Qwen 3.8 27b Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.5 40B Claude 4.5 Opus High Reasoning Thinking uncensored heretic
Qwen · llmfan46
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
QW
Qwen Qwen3 Coder 30B A3B Instruct
Qwen · tensorblock
Params30.5B
Context256K
Smallest11.3 GB
Coding
QW
Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen3 2507 4B Instruct Haiku 4.5 Merged
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.6 GB
GGUF
QW
Qwen2 1.5B Instruct
Qwen · Goekdeniz-Guelmez
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
QW
Qwen3 0.6B Abliterated
Qwen · bartowski
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
QW
Qwen3 30B A3B ArliAI RpR v4 Fast
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3.6 35B A3B DFlash2
Qwen · aminya
Params526M
Context256K
Q4_K_M0.3 GB
GGUF
QW
Qwen2 Audio 7B
Qwen · NexaAI
Params7.75B
Context8K
Q4_K_M4.8 GB
GGUF
QW
Qwen3 4B
Qwen · NobodyWho
Params4B
Context32K
Q4_K_M2.5 GB
GGUF
QW
MN 12B Celeste V1.9
Qwen · adrose98
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen3 14B Base
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen2.5 32B Instruct Abliterated
Qwen · RichardErkhov
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF

Keep browsing