Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 72B Instruct
Qwen · ThomasBaruzier
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Huihui Qwen3 30B A3B Thinking 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
QW
EUAIAct Qwen2.5 0.5B Edge
Qwen · sallani
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · lmstudio-community
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
qwen3 tts 1.7b voicedesign
Qwen · cstr
Params1.92B
Context—
Smallest2.0 GB
GGUF
QW
Dongfangshuo Qwen3.8 27B NSFW
Qwen · dongfangshuo
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3-4B-abliterated
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Scion FlashNext 176B A6B
Qwen · SkyIsNotGreen
Params177B
Context256K
Smallest57.6 GB
ReasoningTool use
QW
Qwen2.5 VL 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
Qwen3.5 35B A3B Claude Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
Reasoning
QW
Qwen3 Uncensored TextEncoders Klein Z Image Anima
Qwen · LuffyTheFox
Params596M
Context40K
Smallest1.2 GB
Coding
QW
Qwen3.6 27B A3B CoderX
Qwen · ManniX-ITA
Params26.2B
Context256K
Q4_K_M16.1 GB
Coding
QW
Replete LLM V2.5 Qwen 14b
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.5 9B The Bradbury F451 Pro Writer Uncensored Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingRoleplayVision
QW
Qwen3.5 9B C3SM SDM Agentic Coder
Qwen · OliviaRossi
Params8.95B
Context256K
Smallest6.5 GB
CodingTool use
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwen3 VL 8B Instruct Abliterated v2
Qwen · qign
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen3 VL 8B Instruct Heretic
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
MiniMax H3 TextEncoder 16GB abliterated
Qwen · pottokao
Params25.8B
Context256K
Smallest12.6 GB
CodingVision
QW
Himeros V2 27B
Qwen · Skttttt
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
QW
Eve V2 Unleashed Qwen3.5 8B Liberated 4K 4B Merged
Qwen · JeffGreen311
Params4.66B
Context256K
Q4_K_M3.4 GB
CodingTool use
QW
Qwen3.5 4B
Qwen · gguf
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
QW
Qwen3.5 9B Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · unsloth
Params1.54B
Context128K
Q4_K_M1.0 GB
Coding
QW
Kataguru Qwen3.8 27B Titan v3.2
Qwen · kataguru
Params26.9B
Context256K
Smallest11.2 GB
ReasoningTool useVision
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Unrestricted
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.8 Whittle MoE 27B A17.8B
Qwen · mradermacher
Params27B
Context256K
Q4_K_M17.4 GB
GGUF
QW
Qwen3.8 27B Humanlike Chat 2.0
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayTool use
QW
Qwen3.8 27B Uncensored
Qwen · jaromer
Params27.3B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.8 9B Distill SLERP F451 Pro Writer Uncensored
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
RoleplayVision

Keep browsing