Qwen GGUF models
37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.
QW
Qwen2.5 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
GRAFT 50B A3B
Qwen · SmallAICreator
Params50.7B
Context256K
Q4_K_M30.9 GB
QW
Qwen3 8B 192k Context 6X Josiefied Uncensored
Qwen · mradermacher
Params8.19B
Context192K
Q4_K_M5.0 GB
QW
Qwen3.5 4B Base
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.8 27B 3MPER0RR Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
voxprint huihui qwen36 27b
Qwen · Mitroshenkov87
Params27.3B
Context—
Smallest0.0 GB
QW
SkillGym Qwen3.5 27B
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Ternary-Bonsai-2-9B-DFlash2
Qwen · suryatmodulus
Params1.47B
Context256K
Smallest1.6 GB
QW
Qwen3 Short Story Instruct Uncensored 262K Ctx 4B
Qwen · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
QW
QwenGram-0.8B REAL-15M R=1
Qwen · Ninnix96
Params783M
Context256K
Q4_K_M0.6 GB
QW
Qwen SEA LION v4 32B IT
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3.8 27B Uncensored
Qwen · Codydaoust
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
ThinkingCap Qwen3.8 27B Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 Whittle MoE 27B A17.8B GGUF all quants
Qwen · scima
Params26.9B
Context256K
Smallest11.3 GB
QW
Qwimi3.5 9B Kimik2.6 Opus Distill MTP
Qwen · trjxter
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen3 0.6B
Qwen · duyntnet
Params752M
Context40K
Q4_K_M0.5 GB
QW
Qwen2.5 3b Chess v7
Qwen · Ryu-tek
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Ostrich 27B 261008 Qwen3.8 Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5 35B A3B
Qwen · titan0115
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen2.5 1.5B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2.5 72B Instruct Abliterated
Qwen · Thaurock
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
QwQ Unofficial 14B Math v0.2
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Sakura Qwen Image 2.1 PE T2I Uncensored
Qwen · webmp3
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.8 27B Uncensored GP100
Qwen · fallentree
Params4.47B
Context256K
Smallest2.8 GB
QW
Qwen3.5 9B GLM Wannabe
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.8 27B Abliterated
Qwen · Grimxlock
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.6 35B A3B StyleTune
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Replete LLM V2.5 Qwen 1.5b
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
QW
Qwen3 ST The Next Generation II E32 v1 256k Ctx 6B
Qwen · mradermacher
Params6.33B
Context256K
Q4_K_M3.9 GB