Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
LightGPT 7B Qwen2
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
QW
Qwentile2.5 32B Instruct
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen3 4B ORPO Advertisement
Qwen · yothinS
Params4B
Context40K
Smallest1.7 GB
GGUF
QW
Qwen3.6 35B A3B Heretic v2
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
QW
Qwen3.8 Flash Next Avalon
Qwen · freriadoc
Params107B
Context256K
Smallest1.5 GB
ReasoningTool use
QW
Qwen3 4b Z Image Engineer V2.5
Qwen · BennyDaBall
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Qwen3 30B A3B Instruct 2507
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
models--Qwen--Qwen2-1.5B-Instruct
Qwen · MaziyarPanahi
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
QW
Qwen3.5-35B-A3B
Qwen · mudler
Params34.7B
Context256K
Smallest17.0 GB
GGUF
QW
Qwen3.8 27B Human KO Enterprise Boundary
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Tool use
QW
qwen2.5 coder 7b cadquery
Qwen · yuvit-batra
Params7.6B
Context32K
Q4_K_M4.7 GB
Coding
QW
Qwen3.8 27B
Qwen · VantCdx
Params27.3B
Context256K
Smallest15.7 GB
Vision
QW
CyberNeurova Qwen2.5 VL 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
Qwen3.8 27B TWIN TURBO Fable Cold Fusion 709 ULTRA HERETIC Uncensored NM DAU NEO MTP
Qwen · Zyszztggd
Params27B
Context—
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3 30B A3B Instruct 2507 FT
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen3.8 27b Noslop
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen2.5 3B Instruct
Qwen · RagnarokChan
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen3.8 27B Uncensored Heretic v3
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
QW
UniReason Qwen3 14B No Think SFT
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Reasoning
QW
Tifa 7B Qwen2 v0.1
Qwen · Tifa-RP
Params7.62B
Context32K
Q4_K_M4.7 GB
Roleplay
QW
Qwen3.5 4B Heretic 2xMerge DavidAU
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningVision
QW
shisa v2.1 qwen3 8b
Qwen · XpressAI
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Huihui Qwen3 Coder Next Opus 4.6 Reasoning Distilled abliterated
Qwen · Momix-44
Params80B
Context256K
Q4_K_M48.5 GB
CodingReasoning
QW
Qwen2.5 Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
QW
Qwen3 Coder Next Opus 4.6 Reasoning Distilled
Qwen · samuelcardillo
Params80B
Context256K
Q4_K_M48.5 GB
CodingReasoning
QW
Aurbliterated_Qwen2_7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.8 27B Cold Fusion GAIN V1.1 NM DAU NEO MAX MTP
Qwen · fribourgquants
Params26.9B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3.5 9B Cyberpunk2077 Xiaotian Qin V2 V3 5pass
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use

Keep browsing