Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
online-dpo-qwen2-4
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
hamo score 0.6b
Qwen · HamoAI
Params596M
Context40K
Smallest0.6 GB
GGUF
QW
ColdBrew Qwen3.5 CharThink Base
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
RuntimeLabs Kayak Qwen3 VL 4B
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
Qwen3.8 27B Cold Fusion GAIN V1.1 NVFP4
Qwen · esatapedico
Params27.3B
Context256K
Smallest14.9 GB
GGUF
QW
Qwen3-32B-128K
Qwen · unsloth
Params32.8B
Context128K
Q4_K_M19.8 GB
GGUF
QW
Qwen3 Embedding 0.6B
Qwen · PeterAM4
Params596M
Context32K
Q4_K_M0.4 GB
Embedding
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · robertbschuette
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen2 0.5B NuminaMath TIR v1
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Code-Gen
Params26.9B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3.5 2B
Qwen · SoAIHQ
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Qwen2.5 Wolverine CODER 11B V2 128k Ctx
Qwen · mradermacher
Params10.9B
Context128K
Q4_K_M6.6 GB
Coding
QW
dnotitia_Smoothie Qwen3 0.6B
Qwen · Alcoft
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · unsloth
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Huihui Qwen3.5 35B A3B Claude 4.6 Opus abliterated Q4 K M
Qwen · cesarsal1nas
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3 VL 2B Instruct heretic
Qwen · saidutta69
Params1.72B
Context256K
Q4_K_M1.1 GB
RoleplayTool useVision
QW
Qwen3.8 Flash Next
Qwen · vcruz305
Params51.2B
Context256K
Q4_K_M2.8 GB
GGUF
QW
Qwen3.8 27B
Qwen · zugquants
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
QW
Qwen3 30B A3B Instruct 2507
Qwen · second-state
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen3.8 Flash Next MTP Strix Halo
Qwen · EasiiX
Params3.88B
Context256K
Smallest4.1 GB
GGUF
QW
Qwen3.5 9B Q4 K M
Qwen · Canfield
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen3 0.9B A0.6B
Qwen · mradermacher
Params860M
Context40K
Q4_K_M0.6 GB
CodingReasoning
QW
Qwen3.6 35B v2 MoE Ablit Heretic Uncensor Hermes MTP Vision FT
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningRoleplayTool use
QW
AgentWorld 35B A3B Heretic
Qwen · auttasak88
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Crow 9B Opus 4.6 Distill Heretic_Qwen3.5
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoning
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningRoleplay
QW
Qwen3.8-27B
Qwen · hammadRahman
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen2.5 1.5b Uncensored
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3.5 9B Abliterated v2 MAX
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision

Keep browsing