Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Coder 30B A3B Instruct Heretic
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
SmartCode Fable 5 CoT Reasoning QKVO Qwen 3.6 27B Distilled
Qwen · mfielding92
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoning
QW
Qwen3.5 2B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningRoleplayVision
QW
Qwen3 30B A3B Gemini Pro High Reasoning 2507 ABLITERATED UNCENSORED
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
QW
Huihui Qwen3 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
QW
Qwen3.5 4B Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
QW
Qwen Image 2.1 Turbo
Qwen · molbal
Params7.12B
Context—
Q4_K_M4.5 GB
GGUF
QW
Qwen2.5-Vl-72B-Instruct
Qwen · unsloth
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
QW
Qwen2.5.1 Coder 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Qwen3.8 27B Fable Distill
Qwen · TeichAI
Params27.3B
Context256K
Q4_K_M17.4 GB
CodingVision
QW
Qwen3.8 Flash Next
Qwen · AnonimousA
Params132B
Context256K
Smallest61.5 GB
GGUF
QW
Qwen3.6 35B A3B DFlash
Qwen · magnitudedev
Params386M
Context40K
Smallest0.4 GB
GGUF
QW
Qwen3 TTS 12Hz 0.6B Base
Qwen · mradermacher
Params600M
Context32K
Q4_K_M0.4 GB
Vision
QW
Qwen3.6 35B A3B DSV4Pro SFT GPT56Sol RL Agent
Qwen · nerkyor
Params34.7B
Context256K
Smallest14.3 GB
Vision
QW
Qwen3.8 2B
Qwen · piskle
Params1.94B
Context256K
Q4_K_M1.3 GB
GGUF
QW
Imperum CybersecurityLLM v1.0
Qwen · IMPERUM
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3.5 0.8B Japanese SFT v2
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
QW
Qwen2.5 Coder 3B Uncensored
Qwen · bappi
Params3.1B
Context32K
Q4_K_M1.9 GB
Coding
QW
ComfyUI Qwen3 VL
Qwen · Abiray
Params8.77B
Context256K
Q4_K_M2.5 GB
Tool useVision
QW
Qwen3 8B ERP v0.1
Qwen · Aratako
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.8 Whittle 16B
Qwen · logic65
Params16.3B
Context256K
Q4_K_M10.1 GB
GGUF
QW
Huihui Qwen3.5 122B A10B Abliterated
Qwen · huihui-ai
Params122B
Context256K
Smallest74.2 GB
Vision
QW
Qwen2.5 Coder 7B Instruct
Qwen · CISCai
Params7.62B
Context32K
Smallest1.9 GB
Coding
QW
Qwen3.5 4B EmperoAI Qwen3.8 Distill Heretic Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
QW
Qwen3.5 4B DFlash
Qwen · magnitudedev
Params634M
Context40K
Smallest0.7 GB
GGUF
QW
Agrillm Qwen3 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen2.5 VL 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
CodingVision
QW
Co Rewarding I Qwen3 8B Base MATH
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
QW
Qwen Image 2.1 Uncensored
Qwen · basileleuwa
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
QW
Qwen3.5-122B-A10B
Qwen · mudler
Params122B
Context256K
Smallest48.3 GB
Vision

Keep browsing