Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 4B
Qwen · daniloreddy
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Andy 3.5 beta
Qwen · Sweaterdog
Params7.62B
Context128K
Smallest15.2 GB
GGUF
QW
Qwen3.6 29B REAP Opus Reasoning Distill MTP
Qwen · barozp
Params28.9B
Context256K
Q4_K_M17.7 GB
ReasoningTool use
QW
X Coder SFT Qwen3 8B
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
CodingReasoningTool use
QW
Ada Coder Qwen2.5 7b
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
QW
nanohat qwen3 0.6b final
Qwen · blackpirates
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
QW
Qwopus3.6 27B Fusion
Qwen · Jackrong
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoning
QW
Qwen3 30B A3B Element6 1M
Qwen · mradermacher
Params30.5B
Context1024K
Q4_K_M18.6 GB
ReasoningRoleplay
QW
Qwen3 8B
Qwen · second-state
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.6 27B Fable Fusion 711 Uncensored Heretic NM DAU NEO MAX MTP
Qwen · Moemajor3
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
ChainCheck Judge Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
MiMo V2.6 Distill Qwen 9B Ablit
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool useVision
QW
Qwen3.5 2B EmperoAI Qwen3.8 Distill Heretic Abliterated
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
QW
Qwen3.5 4B Safety Thinking
Qwen · Merlin-Research
Params4.2B
Context32K
Q4_K_M2.7 GB
ReasoningVision
QW
Qwen3 VL 32B Instruct Heretic v2
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
CodingTool useVision
QW
Selora AI LLM 14B
Qwen · selorahomes
Params14.8B
Context40K
Smallest0.0 GB
GGUF
QW
Qwen3 VL 32B Thinking Abliterated
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningTool useVision
QW
Qwen2.5 Math 1.5B Instruct
Qwen · lmstudio-community
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
QW
Qwen3 14B Heretic
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.8 Flash Next GGUF UD Q4 K XL
Qwen · KENIC-1
Params177B
Context256K
Smallest4.1 GB
Vision
QW
Qwen2 VL 7B Instruct
Qwen · second-state
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
QW
Qwen2.5 VL 7B NSFW Caption V3 Abliterated
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3.8 23B Mini Me Bf16
Qwen · torchsnow
Params22.3B
Context256K
Smallest11.1 GB
Vision
QW
Qwen3.5 2B
Qwen · AaryanK
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
QW
Qwen3.5 27B Unredacted MAX
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen2.5-VL-72B-Instruct
Qwen · Mungert
Params73B
Context125K
Q4_K_M47.7 GB
Vision
QW
Qwen2 1.5b
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
QW
Qwen3 8B ShiningValiant3
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CodingReasoningTool use
QW
Qwen3 4B Pingala8 2bit
Qwen · Genrius-AI
Params1.36B
Context40K
Smallest1.2 GB
ReasoningTool use
QW
Qwen3.8-Flash-Next-102B-A5B-Niwaki-v2.4-3bit
Qwen · neopolita
Params108B
Context256K
Smallest43.8 GB
GGUF

Keep browsing