Qwen GGUF models

37395 GGUF models in the Qwen family, quantized by 10101 uploaders. Sizes run from 1M to 2450B parameters. The longest trained context is 3906K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
QW
qwen3.5 4B typescript coder
Qwen · MassivDash
Params4.2B
Context256K
Q4_K_M2.7 GB
CodingVision
QW
Qwen3.5 27B Uncensored Heretic v2 Native MTP Preserved
Qwen · llmfan46
Params461M
Context256K
Q4_K_M17.2 GB
Vision
QW
Qwen3.8 27B
Qwen · akopytko
Params27.3B
Context—
Smallest0.0 GB
GGUF
QW
Qwen2.5 7B Comment Sexuality Reasoner
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Reasoning
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Parable Qwen3 8B Claude Fable 5
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
QW
imajev 2b
Qwen · mindchain
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
QW
Qwen1.5 MoE A2.7B Chat
Qwen · duyntnet
Params14.3B
Context32K
Q4_K_M9.5 GB
GGUF
QW
Qwen3.8 Flash Next MTP
Qwen · Joakimpalm-Zen
Params3.88B
Context256K
Smallest4.2 GB
ReasoningTool use
QW
Qwen3.5 9B Heretic Ara v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
QW
Qwen3 VL 8B Instruct Unredacted MAX
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen3.8 35B A3B APEX Abliterated Blender v1
Qwen · JohnDOeNNN
Params34.7B
Context256K
Smallest16.5 GB
Coding
QW
Qwen3.5 9B Heretic v2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen 3.8 flash next heretic 3.78bpw
Qwen · soyaakinohara
Params177B
Context256K
Smallest83.6 GB
Vision
QW
Dotnet Coder 14b Merged
Qwen · zipaltrivedi
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
QW
Qwen3 4B Instruct 2507 Heretic v4
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
ReSearch Qwen 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3 Yoyo V4 42B A3B Thinking TOTAL RECALL
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoning
QW
Katy 27B
Qwen · sirfyyn
Params1.92B
Context256K
Smallest0.0 GB
GGUF
QW
Qwen3 0.6B
Qwen · QuantFactory
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
QW
Qwen1.5-1.8B-Chat-AWQ-fp16
Qwen · Qwen
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
QW
sakura-1.5b-qwen2.5-v1.0-fp16
Qwen · SakuraLLM
Params1.78B
Context128K
Smallest3.6 GB
GGUF
QW
Qwen3.5 9B Artemis
Qwen · turintech
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningTool useVision
QW
Qwen3 Psychological Reasoning 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
QW
BiggerCoQ Qwen3 10b
Qwen · mradermacher
Params10.9B
Context40K
Q4_K_M6.6 GB
GGUF
QW
Qwen3.5-0.8B
Qwen · NobodyWho
Params752M
Context256K
Q4_K_M0.5 GB
Tool useVision
QW
Qwen3.5-35B-A3B
Qwen · Mungert
Params34.7B
Context256K
Q4_K_M21.6 GB
Vision
QW
Qwen3.6 35B A3B Heretic Cerebellum
Qwen · deucebucket
Params34.7B
Context256K
Smallest12.0 GB
Vision
QW
Qwen3-Vl-235B-A22B-Thinking
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningVision
QW
Meissa Qwen2.5 7B Instruct
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
Roleplay

Keep browsing