Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B
Qwen · DavidAU
Params27B
Context256K
Q4_K_M16.5 GB
CodingReasoningVision
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO MTP DFlash2
Qwen · nerkyor
Params27.3B
Context256K
Smallest3.2 GB
CodingReasoningTool use
GP
Gpt-Oss-20B
gpt-oss · unsloth
Params20.9B
Context128K
Q4_K_M11.6 GB
GGUF
QW
Swift Qwen3.8 27b
Qwen · ukisai
Params27.3B
Context256K
Q4_K_M18.0 GB
ReasoningVision
QW
Qwen3.8-27B-Uncensored-Cyber
Qwen · philbert440
Params27B
Context256K
Q4_K_M19.0 GB
Vision
QW
Qwen3.8 27B OBLITERATED
Qwen · OBLITERATUS
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Qwen3.8 27B Fable 5 Coding Distilled
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
QW
Qwen3.6 27B Fable Fusion 711 Uncensored Heretic NM DAU NEO MAX MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
LT
LTX 2.3
Ltx · unsloth
Params21B
Context—
Q4_K_M14.2 GB
GGUF
GE
Gemma4-26B-A4B-QAT-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params25.2B
Context256K
Q4_K_M16.8 GB
RoleplayVision
TE
Tess 4 27B
Tess · migtissera
Params27B
Context256K
Q4_K_M2.0 GB
ReasoningVision
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · huihui-ai
Params10B
Context—
Smallest10.9 GB
GGUF
QW
Qwen3-30B-A3B-Instruct-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen3.6-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.8 GB
Vision
WA
Wan2.2 Animate 14B
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.5 GB
GGUF
QW
Qwen Image 2512
Qwen · unsloth
Params20.4B
Context—
Q4_K_M13.3 GB
GGUF
QW
Qwen3.8 27B Cold Fusion GAIN V1.1 NM DAU NEO MAX MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3 14B Awq Compatible Instruct
Qwen · Qwen
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
MI
MiniMax H3 GGUFs
Minimax · realrebelai
Params33.1B
Context—
Q4_K_M14.6 GB
GGUF
GE
Gemmable 4 12B MTP
Gemma · Mia-AiLab
Params11.9B
Context256K
Q4_K_M0.3 GB
Reasoning
LF
LFM2.5 24B A2B
Lfm · DavidAU
Params24B
Context128K
Smallest10.5 GB
CodingReasoning
QW
Qwen2.5 Coder 7B Instruct GGUF
Qwen · Qwen
Params15B
Context128K
Q4_K_M9.4 GB
Coding
QW
Qwen3.6 14B A3B FableVibes Hf
Qwen · tvall43
Params13.8B
Context256K
Q4_K_M8.5 GB
CodingReasoningTool use
QW
Qwen3.8 27B Uncensored Cyber agentic imatrix
Qwen · cyjin-yl
Params31B
Context—
Smallest0.0 GB
Vision
WA
Wan2.2 T2V A14B
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
ME
Mellum2.1-12B-A2.5B-Thinking
Mellum · JetBrains
Params12.1B
Context128K
Q4_K_M8.1 GB
Reasoning
QW
Qwen3.8 27B Ridge
Qwen · empero-ai
Params27.3B
Context256K
Smallest12.6 GB
ReasoningVision
QW
Qwen3.8 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
Vision
GE
Gemma-4-31B-It
Gemma · unsloth
Params30.7B
Context256K
Q4_K_M18.3 GB
Vision

Other sizes

Keep browsing