Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
unmuzzle qwen14b abliterated
Qwen · zjj1993
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen2.5 Coder 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 0.8B
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3 VL 8B Instruct Abliterated v1
Qwen · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Zwielicht 27B
Qwen · Nimbz
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 2B Heretic Max
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen2.5 7B
Qwen · QuantFactory
Params7.6B
Context128K
Q4_K_M4.7 GB
QW
qwen25 coder 3b uncensored
Qwen · tthanhannguyen
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2.5 VL 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
QW
Qwen2.5 Coder 32B
Qwen · xxris
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3.8 27B OBLITERATED
Qwen · minte1431
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
qwen2.5 coder 3b pentest
Qwen · fawazo
Params3.1B
Context32K
Q4_K_M1.9 GB
QW
Qwen3 54B A3B 2507 YOYO2 TOTAL RECALL Instruct
Qwen · mradermacher
Params53B
Context986K
Q4_K_M32.1 GB
QW
Qwen3.8B 27B Mix
Qwen · Deathsquad10
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B OBLITERATED22 AGENT
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
xpo-qwen2
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen3.5-4B
Qwen · ISTA-DASLab
Params4.21B
Context256K
Smallest1.9 GB
QW
qwen3 14B Q5 K M
Qwen · k1nto
Params14.8B
Context40K
Smallest10.5 GB
QW
Qwen3.8 27B Jumbo Fusion IQ 747 900 Turbo Brilliance 50X Reasoning Instruct GGUF UltraOptimised
Qwen · Solstice-AI
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
MARTHA LXVIII.21b_QWEN 3.5 3.6_prune_27b 3.6_base
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
QW
Qwen3 Coder Next REAM
Qwen · mradermacher
Params60B
Context256K
Q4_K_M36.7 GB
QW
Qwen3.5 122B A10B Claude Distill
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
QW
Qwen3.8 27B TURBO MAX
Qwen · Jogmg
Params26.9B
Context256K
Q4_K_M18.0 GB
QW
Huihui Qwen3.5 35B A3B abliterated Q4 K M
Qwen · cesarsal1nas
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen2.5 14B lora sex v2 float16
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Dumpling Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
LFM2 8B A1B Instruct Quantum IQ1C Qwen3.6 35B A3B DISTILL2
Qwen · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB
QW
Swift Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Fable 5 Coding Distilled
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen Qwen2.5 Coder 14B Instruct
Qwen · sigmanih
Params14.8B
Context32K
Q4_K_M9.0 GB