Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 9B Uncensored
Qwen · xCloudinfo
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
QW
Qwen3 14B Gemini 3 Pro Preview High Reasoning Distill
Qwen · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning
QW
Qwen3 53B A3B 2507 THINKING TOTAL RECALL v2 MASTER CODER
Qwen · mradermacher
Params53B
Context256K
Q4_K_M32.1 GB
CodingReasoning
QW
Replete LLM V2.5 Qwen 0.5b
Qwen · bartowski
Params630M
Context32K
Q4_K_M0.5 GB
GGUF
QW
asmr qwen3.5 9b zh cn echo gguf v0.1
Qwen · mmis1000
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Qwen2.5 32B Instruct Abliterated v2
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
QW
Qwen3.5 35B A3B Kazakh
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.8 Flash Next 99B A5B Niwaki 3bit
Qwen · neopolita
Params105B
Context256K
Smallest42.5 GB
GGUF
QW
Qwen3.6 27B Abliterated MTP
Qwen · gaston-parravicini
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Rombos Coder V2.5 Qwen 32b
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Coding
QW
Qwen3.8-27B
Qwen · Snowwhite00
Params27.3B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Mixture Summarizer Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
QW
Qwen3 VL 8B Instruct C_Abliterated v3
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
CodingVision
QW
Qwen2.5 Coder 32B Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
QW
Qwen2.5 Coder 32B Instruct
Qwen · unsloth
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QW
ThinkLite Critic 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
QW
NQLSG Qwen2.5 14B MegaFusion v5 Roleplay
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
QW
Qwen3 1.7B heretic
Qwen · saidutta69
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen3.5 9B Gemini 3.1 Pro Reasoning Distill
Qwen · Tet3u
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningVision
QW
STEM Oracle
Qwen · Verdugie
Params26.9B
Context256K
Q4_K_M16.5 GB
Reasoning
QW
Qwen3 14B Base
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
BugTraceAI CORE Ultra 27B Q6
Qwen · BugTraceAI
Params26.9B
Context256K
Smallest22.1 GB
ReasoningTool use
QW
Qwen 3.5 0.8B Uncensored Conversational
Qwen · minas2025
Params752M
Context256K
Smallest0.8 GB
Vision
QW
Qwen Image 2.1 Turbo
Qwen · off-grid-ai
Params7.12B
Context—
Smallest4.1 GB
GGUF
QW
Qwen2.5 2X7B Coder VisCoder Coder Instruct OlympicCoder 19B
Qwen · mradermacher
Params19B
Context32K
Q4_K_M11.6 GB
Coding
QW
Qwen3 4B Cybersecurity Heretic 16bit
Qwen · sillykiwi
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
Qwen2-57B-A14B-Instruct
Qwen · legraphista
Params57.4B
Context32K
Smallest21.1 GB
GGUF
QW
Qwen3 Sex
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
QW
Qwen2.5 Coder 7B
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
QW
Hermes-4-14B
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.5 GB
ReasoningRoleplayTool use

Keep browsing