Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
ThinkingCap Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
QW
Qwen3 VL 8B Instruct heretic
Qwen · saidutta69
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Qwen2.5 14B Instruct Darija
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
XORTRON AgentRICO
Qwen · darkc0de
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
QW
gte-Qwen2-7B-instruct
Qwen · RichardErkhov
Params7.61B
Context128K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · python-jo
Params177B
Context256K
Q4_K_M1.9 GB
ReasoningTool useVision
QW
Qwen3 4B Kimi2.5 Reasoning Distilled
Qwen · khazarai
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
QW
Qwen3 VL 30B A3B Instruct Abliterated v1
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
QW
Qwen3 VL 32B Thinking Abliterated v1
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningTool useVision
QW
Qwen3.8 27B Uncensored
Qwen · Qui-Linta13
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3 Esper3 Reasoning CODER Instruct 21B Brainstorm20x
Qwen · mradermacher
Params21B
Context40K
Q4_K_M12.8 GB
CodingReasoning
QW
Spark X2.5 4B Therapy InterleavedThink Qwen38FlashNext MiniMaxM3 GLM5.3 ZCode SFT8K MultiDPO v3h
Qwen · denjhang
Params4.1B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
QW
Qwen3 30B A3B YOYO V2 GLM 4.7 Flash Instruct
Qwen · mradermacher
Params30.5B
Context986K
Q4_K_M18.6 GB
ReasoningTool use
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · sheldonrobinson
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
QW
Qwen3 8B
Qwen · lm-kit
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Arch Router
Qwen · katanemo
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct Jbliterated
Qwen · ApolloRaines
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
QW
Ostrich 27B 261028 Qwen3.8 Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen1.5-110B-Chat
Qwen · second-state
Params111B
Context32K
Q4_K_M67.2 GB
GGUF
QW
Qwen2.5 Wolverine CODER 11B
Qwen · mradermacher
Params10.9B
Context32K
Q4_K_M6.6 GB
Coding
QW
UnifiedReward 2.0 Qwen 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3.5-9B
Qwen · Fix-AI
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool useVision
QW
Qwen3.6-35B-A3B
Qwen · sphaela
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
QW
AllThingsIntel-Apollo-V0.1-4B-Thinking-Q4_K_M
Qwen · AllThingsIntel
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
QW
Qwen3.8 27B Dominatrix
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
QW
ElisNovel V1 14B
Qwen · cyanelis
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
QW
QwQ 32B ArliAI RpR v4
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.9 GB
Reasoning
QW
Qwen3-ASR-0.6B
Qwen · OpenVoiceOS
Params938M
Context—
Smallest1.9 GB
GGUF
QW
Qwen3.5 122B A10B
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
QW
Qwen 3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision

Keep browsing