Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
unmuzzle qwen14b abliterated
Qwen · zjj1993
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
QW
Qwen3.5 0.8B
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen3 VL 8B Instruct Abliterated v1
Qwen · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Zwielicht 27B
Qwen · Nimbz
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplay
QW
Qwen3.8 2B Heretic Max
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Qwen2.5 7B
Qwen · QuantFactory
Params7.6B
Context128K
Q4_K_M4.7 GB
GGUF
QW
qwen25 coder 3b uncensored
Qwen · tthanhannguyen
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
QW
Qwen2.5 VL 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
Qwen2.5 Coder 32B
Qwen · xxris
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QW
Qwen3.8 27B OBLITERATED
Qwen · minte1431
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
qwen2.5 coder 3b pentest
Qwen · fawazo
Params3.1B
Context32K
Q4_K_M1.9 GB
Coding
QW
Qwen3 54B A3B 2507 YOYO2 TOTAL RECALL Instruct
Qwen · mradermacher
Params53B
Context986K
Q4_K_M32.1 GB
CodingReasoningTool use
QW
Qwen3.8B 27B Mix
Qwen · Deathsquad10
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.8 27B OBLITERATED22 AGENT
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
xpo-qwen2
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen3.5-4B
Qwen · ISTA-DASLab
Params4.21B
Context256K
Smallest1.9 GB
GGUF
QW
qwen3 14B Q5 K M
Qwen · k1nto
Params14.8B
Context40K
Smallest10.5 GB
ReasoningTool use
QW
Qwen3.8 27B Jumbo Fusion IQ 747 900 Turbo Brilliance 50X Reasoning Instruct GGUF UltraOptimised
Qwen · Solstice-AI
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
MARTHA LXVIII.21b_QWEN 3.5 3.6_prune_27b 3.6_base
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
RoleplayVision
QW
Qwen3 Coder Next REAM
Qwen · mradermacher
Params60B
Context256K
Q4_K_M36.7 GB
Coding
QW
Qwen3.5 122B A10B Claude Distill
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
Vision
QW
Qwen3.8 27B TURBO MAX
Qwen · Jogmg
Params26.9B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Huihui Qwen3.5 35B A3B abliterated Q4 K M
Qwen · cesarsal1nas
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Qwen2.5 14B lora sex v2 float16
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Dumpling Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
QW
LFM2 8B A1B Instruct Quantum IQ1C Qwen3.6 35B A3B DISTILL2
Qwen · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB
GGUF
QW
Swift Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
QW
Qwen3.8 27B Fable 5 Coding Distilled
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
QW
Qwen Qwen2.5 Coder 14B Instruct
Qwen · sigmanih
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use

Keep browsing