Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B Uncensored
Qwen · trklzz
Params27.3B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
CodingTool use
QW
Qwen3.8 27B Optimal Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen2.5 1.5B Instruct
Qwen · zkkdinx
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · mudler
Params177B
Context256K
Smallest73.0 GB
GGUF
QW
Qwen2 Boundless
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Huihui Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
QW
dolphin-2.9.3-qwen2-1.5b
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingTool use
QW
Qwen3.8 27B Cold Fusion GAIN V1.1
Qwen · zerodigest
Params27.3B
Context256K
Smallest9.7 GB
GGUF
QW
Qwen3.5 0.8B GPT6 Luna Distill Karpy
Qwen · NasledieLab
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Openbuddy Qwen2.5Llamaify 14b v23.3 200k
Qwen · mradermacher
Params14.8B
Context195K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.8 Flash Next MTP block
Qwen · paperniuk
Params2.61B
Context256K
Smallest1.5 GB
ReasoningTool use
QW
Qwen3 VL 8B NSFW Caption V4
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen SEA LION v4 8B VL
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Qwen3.5 122B A10B Abliterated v1
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
QW
CapRL Qwen3VL 4B
Qwen · internlm
Params4.41B
Context256K
Q4_K_M2.7 GB
Tool useVision
QW
Qwen AgentWorld 35B A3B
Qwen · DhruvalLabs
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Sanshoku Qwen3.8 3.6 27B blend
Qwen · oshiteku
Params27.3B
Context256K
Smallest6.3 GB
Vision
QW
Qwen3.5 9B RolePlay Merged
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Roleplay
QW
Qwen3 Next 80B A3B Instruct
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
Tool use
QW
Qwen3-ASR-1.7B
Qwen · sakasegawa
Params2.04B
Context—
Smallest1.2 GB
GGUF
QW
Qwen3.8 27B TWIN TURBO Fable Cold Fusion 709 L Uncensored NM DAU NEO MTP
Qwen · johnsun4414
Params27B
Context256K
Q4_K_M16.5 GB
CodingReasoningRoleplay
QW
MiMo V2.6 Distill Qwen 9B Ablitrated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool use
QW
Qwen3.8 27B DFlash2 Bonsai2 ternary
Qwen · Cyronius
Params1.92B
Context256K
Smallest0.7 GB
ReasoningTool use
QW
Qwen2.5 Coder 32B Instruct
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QW
Qwen3.8 27B Leimroth3
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.8 27B OBLITERATED22
Qwen · shoukewei
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
QwQ 32B Preview
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
QW
Qwen3.8 27B
Qwen · Brian6145
Params461M
Context—
Q4_K_M16.8 GB
GGUF
QW
Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · Vladimir13569
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision

Keep browsing