Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8-27B
Qwen · YTan2000
Params27.3B
Context256K
Smallest14.5 GB
Vision
QW
Qwen2.5 7B Instruct Abliterated v2
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
OpenSpatial Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
QW
Qwen3.6 27B Fable Fusion 711 Uncensored Heretic NM DAU NEO MAX MTP
Qwen · tatekuperus
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
QW
Negentropy claude opus 4.7 9B
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
QW
Qwen2 VL 2B Instruct
Qwen · lmstudio-community
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
QW
Qwen2.5 Coder 32B Abliterated
Qwen · TobiasLogic
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.8 27B Humanlike Chat 2.0
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayTool useVision
QW
Qwen3 1.7B Distilled 30B A3B SFT
Qwen · reaperdoesntknow
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
QW
Qwen2.5 72B Instruct Malaysian
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · shefowl
Params139B
Context256K
Smallest56.5 GB
GGUF
QW
FishAudio Drama3 TTS 83Lang Qwen3.5 35B A3B FP8 BF16
Qwen · AMAImedia
Params35B
Context—
Smallest23.4 GB
GGUF
QW
Qwen3.5 9B GLM5.1 Distill v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
QW
Qwen3.8 27B TTURBO Cold Fusion 709 L Uncensored UltraOptimised VariableThinking 1M
Qwen · Solstice-AI
Params461M
Context256K
Q4_K_M18.5 GB
ReasoningVision
QW
Qwen3.8 Flash Next Heretic 2
Qwen · spiritfather
Params177B
Context256K
Q4_K_M2.8 GB
Vision
QW
Huihui Qwen3.5 4B Abliterated
Qwen · interimlabs
Params4.21B
Context256K
Smallest2.7 GB
GGUF
QW
qwen3 tts 0 6b base mix precision
Qwen · Arm
Params83M
Context64K
Smallest0.1 GB
GGUF
QW
ExpertLens Qwen3 VL 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
QW
Qwen3 4B Thinking Heretic
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
ReasoningRoleplayTool use
QW
Qwen3 VisionCaption 2B
Qwen · prithivMLmods
Params1.72B
Context256K
Smallest1.8 GB
Vision
QW
Qwen3 53B A3B TOTAL RECALL v1.4
Qwen · mradermacher
Params53B
Context40K
Q4_K_M32.1 GB
CodingReasoningTool use
QW
Josiefied Qwen3 30B A3B Abliterated v1
Qwen · Disya
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
QW
Qwen3.8 9B Distill
Qwen · superisaac1262
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
QW
Qwen2.5 Coder 3B Instruct heretic
Qwen · saidutta69
Params3.1B
Context32K
Q4_K_M1.9 GB
CodingRoleplay
QW
Qwen3.8 27B Uncensored Heretic v2
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.1 GB
Vision
QW
Qwen3.8 27B
Qwen · arbonquants
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
QW
Einstein-v7-Qwen2-7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
QW
Hemmingway 1 Uncensored Heretic
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.5 GB
GGUF

Keep browsing