Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Coder 30B A3B Instruct
Qwen · ggml-org
Params30.5B
Context256K
Smallest32.5 GB
Coding
QW
MiroThinker-v1.5-30B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
Reasoning
QW
Qwen3.8 27B Uncensored FP8
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
QW
Qwen3.8-27B
Qwen · jakeatx
Params27.3B
Context256K
Smallest15.6 GB
GGUF
QW
Qwen3 30B A3B Architect18
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningRoleplayTool use
QW
flux2 klein 4B uncensored text encoder
Qwen · WeReCooking
Params4B
Context40K
Smallest2.4 GB
Coding
QW
qwen3 tts 0.6b base
Qwen · cstr
Params915M
Context—
Smallest0.5 GB
GGUF
QW
qwen3 coder 30b a3b compacted 19b 256k
Qwen · continuum-ai
Params19.7B
Context256K
Q4_K_M12.0 GB
CodingEmbeddingTool use
QW
Qwen3 4B Hivemind Instruct Heretic Abliterated Uncensored NEO Imatrix
Qwen · DavidAU
Params4B
Context256K
Q4_K_M2.5 GB
Roleplay
QW
Qwen3.8 27B Uncensored Chinese
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen3.8 27B Heretic Uncensored Q6 K
Qwen · mlasli
Params27.3B
Context256K
Smallest22.5 GB
Roleplay
QW
Qwen3 8B JP Uncensored
Qwen · ryo559
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.5 abliterated MAX AIO
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
Vision
QW
Qwen3.8 Flash Next Uncensored Q4 K M MTP
Qwen · him0413
Params180B
Context256K
Q4_K_M121.0 GB
Vision
QW
Qwen3.8 27B TQ
Qwen · YTan2000
Params27.3B
Context256K
Smallest0.8 GB
GGUF
QW
Qwen3 4B toolcalling gguf codex
Qwen · Manojb
Params4B
Context256K
Smallest4.3 GB
CodingTool use
QW
Qwen3.5 4B
Qwen · dahara1
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
QW
Swift 1.5 Qwen3.8 27b Heretic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
QwenPaw Flash 9B heretic MTP
Qwen · SC117
Params456M
Context256K
Q4_K_M5.8 GB
Tool useVision
QW
security 8b
Qwen · bebrws
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
QW
Huihui Qwen3.5 27B Abliterated
Qwen · HeYujie
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.5 122B A10B Heretic v2
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QW
Qwen3.8-Flash-Next-DFlash2
Qwen · incoai
Params603M
Context256K
Q4_K_M0.4 GB
ReasoningTool use
QW
Qwen3.8 27B Uncensored
Qwen · prakharprasad
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.6 27B Abliterated Heretic Uncensored BF16 v4
Qwen · Youssofal
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.8-Flash-Next DS4 Q4 ple
Qwen · ivanfioravanti
Params51.2B
Context—
Smallest32.0 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · unsloth
Params3.09B
Context128K
Q4_K_M1.9 GB
Coding
QW
Qwen2.5 14B Instruct
Qwen · ThomasBaruzier
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.8 27B Heretic Uncensored Q4 K M
Qwen · mlasli
Params27.3B
Context256K
Q4_K_M17.0 GB
Roleplay

Keep browsing