Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Qwen3.5 4B
Qwen · daniloreddy
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Andy 3.5 beta
Qwen · Sweaterdog
Params7.62B
Context128K
Smallest15.2 GB
QW
Qwen3.6 29B REAP Opus Reasoning Distill MTP
Qwen · barozp
Params28.9B
Context256K
Q4_K_M17.7 GB
QW
X Coder SFT Qwen3 8B
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
Ada Coder Qwen2.5 7b
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
nanohat qwen3 0.6b final
Qwen · blackpirates
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwopus3.6 27B Fusion
Qwen · Jackrong
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 30B A3B Element6 1M
Qwen · mradermacher
Params30.5B
Context1024K
Q4_K_M18.6 GB
QW
Qwen3 8B
Qwen · second-state
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.6 27B Fable Fusion 711 Uncensored Heretic NM DAU NEO MAX MTP
Qwen · Moemajor3
Params27B
Context256K
Q4_K_M18.0 GB
QW
ChainCheck Judge Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
MiMo V2.6 Distill Qwen 9B Ablit
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 2B EmperoAI Qwen3.8 Distill Heretic Abliterated
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3.5 4B Safety Thinking
Qwen · Merlin-Research
Params4.2B
Context32K
Q4_K_M2.7 GB
QW
Qwen3 VL 32B Instruct Heretic v2
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
Selora AI LLM 14B
Qwen · selorahomes
Params14.8B
Context40K
Smallest0.0 GB
QW
Qwen3 VL 32B Thinking Abliterated
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · lmstudio-community
Params1.54B
Context4K
Q4_K_M1.0 GB
QW
Qwen3 14B Heretic
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3.8 Flash Next GGUF UD Q4 K XL
Qwen · KENIC-1
Params177B
Context256K
Smallest4.1 GB
QW
Qwen2 VL 7B Instruct
Qwen · second-state
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 VL 7B NSFW Caption V3 Abliterated
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.8 23B Mini Me Bf16
Qwen · torchsnow
Params22.3B
Context256K
Smallest11.1 GB
QW
Qwen3.5 2B
Qwen · AaryanK
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3.5 27B Unredacted MAX
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwen2.5-VL-72B-Instruct
Qwen · Mungert
Params73B
Context125K
Q4_K_M47.7 GB
QW
Qwen2 1.5b
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
Qwen3 8B ShiningValiant3
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3 4B Pingala8 2bit
Qwen · Genrius-AI
Params1.36B
Context40K
Smallest1.2 GB
QW
Qwen3.8-Flash-Next-102B-A5B-Niwaki-v2.4-3bit
Qwen · neopolita
Params108B
Context256K
Smallest43.8 GB