Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
cantonese_llm_v2_chat_nemo_GRPO_Qwen3 30B A3B Think 2507
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
Reasoning
QW
Qwen3Vl 235b A22B Thinking
Qwen · Qwen
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningVision
QW
DreamFast Qwen3 8b Heretic
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Coding
QW
Hamanasu QwQ V1.5 Instruct i1
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningRoleplay
QW
halogen qwen3.8 flash next uncensored
Qwen · davenetdev
Params177B
Context256K
Smallest97.5 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
QW
Qwen3.6 35B A3B
Qwen · cafkafk
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3 VL 4b Heretic
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NM DAU
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen3.6 27B
Qwen · vvsotnikov
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
QW
Qwen3.8 27B Med Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen1.5-14B-Chat-AWQ-fp16
Qwen · Qwen
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
QW
ThinkingCap Qwen3.6 27B MTP
Qwen · protoLabsAI
Params461M
Context256K
Q4_K_M15.7 GB
ReasoningVision
QW
Qwen3.5 9B
Qwen · Zirconium419122
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
QW
Qwen3 MOE 6x6B Star Trek Universe Alpha 256k Ctx 36B
Qwen · mradermacher
Params26.5B
Context256K
Q4_K_M16.1 GB
CodingReasoning
QW
Qwen3.8 27B
Qwen · drawthingsai
Params27.3B
Context256K
Smallest8.8 GB
CodingReasoningTool use
QW
Qwen2.5 Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
QW
magi beta 1
Qwen · GEHIRNS
Params4.21B
Context256K
Smallest2.0 GB
ReasoningTool use
QW
Qwen2.5 Lumen 14B i1
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
QW
Qwen3 30B A3B
Qwen · Lake5969
Params30.5B
Context40K
Smallest16.3 GB
GGUF
QW
Qwen3.5 9B Holodeck Lounge
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
RoleplayVision
QW
Qwen2.5 Sex
Qwen · ystemsrx
Params1.54B
Context—
Smallest3.1 GB
GGUF
QW
ThinkingCap-Qwen3.8-27B-abliterated
Qwen · groxaxo
Params27.3B
Context256K
Smallest1.4 GB
ReasoningVision
QW
LongWriter Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.8 27B OBLITERATED
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Andy 4.2 Air
Qwen · Mindcraft-CE
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · ThomasBaruzier
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
ComfyUI Qwen3 VL
Qwen · makisekurisu-jp
Params11.9B
Context256K
Smallest4.6 GB
Vision
QW
Qwen3.5 9B Janus Abliterated V2 Safetensors
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Roleplay
QW
Qwen3.5 27B Ultra Uncensored Heretic v1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF

Keep browsing