Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 27B
Qwen · DavidAU
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO MTP DFlash2
Qwen · nerkyor
Params27.3B
Context256K
Smallest3.2 GB
GP
Gpt-Oss-20B
gpt-oss · unsloth
Params20.9B
Context128K
Q4_K_M11.6 GB
QW
Swift Qwen3.8 27b
Qwen · ukisai
Params27.3B
Context256K
Q4_K_M18.0 GB
QW
Qwen3.8-27B-Uncensored-Cyber
Qwen · philbert440
Params27B
Context256K
Q4_K_M19.0 GB
QW
Qwen3.8 27B OBLITERATED
Qwen · OBLITERATUS
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.8 27B Fable 5 Coding Distilled
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.6 27B Fable Fusion 711 Uncensored Heretic NM DAU NEO MAX MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
LT
LTX 2.3
Ltx · unsloth
Params21B
Context—
Q4_K_M14.2 GB
GE
Gemma4-26B-A4B-QAT-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params25.2B
Context256K
Q4_K_M16.8 GB
TE
Tess 4 27B
Tess · migtissera
Params27B
Context256K
Q4_K_M2.0 GB
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · huihui-ai
Params10B
Context—
Smallest10.9 GB
QW
Qwen3-30B-A3B-Instruct-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.6-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.8 GB
WA
Wan2.2 Animate 14B
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.5 GB
QW
Qwen Image 2512
Qwen · unsloth
Params20.4B
Context—
Q4_K_M13.3 GB
QW
Qwen3.8 27B Cold Fusion GAIN V1.1 NM DAU NEO MAX MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
QW
Qwen3 14B Awq Compatible Instruct
Qwen · Qwen
Params14.8B
Context40K
Q4_K_M9.0 GB
MI
MiniMax H3 GGUFs
Minimax · realrebelai
Params33.1B
Context—
Q4_K_M14.6 GB
GE
Gemmable 4 12B MTP
Gemma · Mia-AiLab
Params11.9B
Context256K
Q4_K_M0.3 GB
LF
LFM2.5 24B A2B
Lfm · DavidAU
Params24B
Context128K
Smallest10.5 GB
QW
Qwen2.5 Coder 7B Instruct GGUF
Qwen · Qwen
Params15B
Context128K
Q4_K_M9.4 GB
QW
Qwen3.6 14B A3B FableVibes Hf
Qwen · tvall43
Params13.8B
Context256K
Q4_K_M8.5 GB
QW
Qwen3.8 27B Uncensored Cyber agentic imatrix
Qwen · cyjin-yl
Params31B
Context—
Smallest0.0 GB
WA
Wan2.2 T2V A14B
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
ME
Mellum2.1-12B-A2.5B-Thinking
Mellum · JetBrains
Params12.1B
Context128K
Q4_K_M8.1 GB
QW
Qwen3.8 27B Ridge
Qwen · empero-ai
Params27.3B
Context256K
Smallest12.6 GB
QW
Qwen3.8 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
GE
Gemma-4-31B-It
Gemma · unsloth
Params30.7B
Context256K
Q4_K_M18.3 GB