Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
GRAFT 50B A3B
Qwen · SmallAICreator
Params50.7B
Context256K
Q4_K_M30.9 GB
Tool use
QW
Qwen3 8B 192k Context 6X Josiefied Uncensored
Qwen · mradermacher
Params8.19B
Context192K
Q4_K_M5.0 GB
Reasoning
QW
Qwen3.5 4B Base
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3.8 27B 3MPER0RR Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
voxprint huihui qwen36 27b
Qwen · Mitroshenkov87
Params27.3B
Context—
Smallest0.0 GB
GGUF
QW
SkillGym Qwen3.5 27B
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Tool useVision
QW
Ternary-Bonsai-2-9B-DFlash2
Qwen · suryatmodulus
Params1.47B
Context256K
Smallest1.6 GB
Vision
QW
Qwen3 Short Story Instruct Uncensored 262K Ctx 4B
Qwen · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
QW
QwenGram-0.8B REAL-15M R=1
Qwen · Ninnix96
Params783M
Context256K
Q4_K_M0.6 GB
GGUF
QW
Qwen SEA LION v4 32B IT
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen3.8 27B Uncensored
Qwen · Codydaoust
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
QW
ThinkingCap Qwen3.8 27B Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
QW
Qwen3.8 Whittle MoE 27B A17.8B GGUF all quants
Qwen · scima
Params26.9B
Context256K
Smallest11.3 GB
GGUF
QW
Qwimi3.5 9B Kimik2.6 Opus Distill MTP
Qwen · trjxter
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningVision
QW
Qwen3 0.6B
Qwen · duyntnet
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
QW
Qwen2.5 3b Chess v7
Qwen · Ryu-tek
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Ostrich 27B 261008 Qwen3.8 Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.5 35B A3B
Qwen · titan0115
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Qwen2.5 1.5B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
QW
Qwen2.5 72B Instruct Abliterated
Qwen · Thaurock
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
QwQ Unofficial 14B Math v0.2
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
QW
Sakura Qwen Image 2.1 PE T2I Uncensored
Qwen · webmp3
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Qwen3.8 27B Uncensored GP100
Qwen · fallentree
Params4.47B
Context256K
Smallest2.8 GB
Vision
QW
Qwen3.5 9B GLM Wannabe
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Qwen3.8 27B Abliterated
Qwen · Grimxlock
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B StyleTune
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
RoleplayVision
QW
Replete LLM V2.5 Qwen 1.5b
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
QW
Qwen3 ST The Next Generation II E32 v1 256k Ctx 6B
Qwen · mradermacher
Params6.33B
Context256K
Q4_K_M3.9 GB
CodingReasoning

Keep browsing