Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
calme-2.2-qwen2-72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen3 VL 8B Instruct
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
QiMing Holos Plus Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen2.5 3B Instruct Heretic
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen3 VL 30B A3B Thinking
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningVision
QW
Huihui Qwen3.8 27B Abliterated NVFP4
Qwen · renketong
Params27.3B
Context256K
Smallest19.7 GB
Vision
QW
Qwen3.6-35B-A3B
Qwen · AtomicChat
Params447M
Context256K
Smallest17.7 GB
Vision
QW
Qwen3.8 Queen 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Roleplay
QW
Replete LLM V2.5 Qwen 3b
Qwen · bartowski
Params3.4B
Context32K
Q4_K_M2.1 GB
GGUF
QW
Huihui Qwen3 Coder Next Opus 4.6 Reasoning Distilled Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
CodingReasoningTool use
QW
Qwen3 Nemotron 32B RLBFF
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
CodeQwen1.5 7B Chat
Qwen · Qwen
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
QW
Qwen35B Agent R2 Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · zugquants
Params26.9B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
MiMo V2.6 Distill Qwen 9B
Qwen · webmp3
Params8.95B
Context256K
Smallest4.1 GB
Vision
QW
Qwen3.5-9b-Sushi-Coder-RL
Qwen · bigatuna
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningVision
QW
Qwen3.5 9B Ultra Uncensored Heretic v2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Zhi Create Qwen3 32B
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
Reasoning
QW
VellumMini 0.1 Qwen3 14B
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
ThinkingCap Qwen3.6 27B Heretic
Qwen · egibson
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
QW
Qwen3.5 122B A10B Abliterated
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
QW
Qwen3 Reranker 8B
Qwen · QuantFactory
Params8.2B
Context40K
Q4_K_M5.0 GB
Embedding
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Cdimabusinessent
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3.5 9B Claude 4.6 OS HERETIC UNCENSORED INSTRUCT
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplayTool use
QW
Qwen3 7B Instruct Q4 K M
Qwen · Ygz-08123
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Swift 1.5 Qwen3.8 27b
Qwen · br1nz
Params27B
Context256K
Smallest10.9 GB
GGUF
QW
Rombos LLM V2.6 Qwen 14b
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwen3 14B Heretic
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwopus GLM 18B Merged
Qwen · Jackrong
Params15.9B
Context256K
Q4_K_M9.8 GB
CodingReasoningTool use

Keep browsing