Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
GE
Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8-27B
Qwen · Fhjdjdbxhshsh
Params27.3B
Context256K
Q4_K_M16.6 GB
LO
LoKuS 13B
Lokus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MA
Magidonia 24B v4.3 Heretic v1.2
Magidonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.5 27B Uncensored Heretic v1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
PR
PreciseCoder 27B
Precisecoder · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.4 GB
LI
Lingshu 32B
Lingshu · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
QwQ 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
MI
MiniMax-H3 fl2va
Minimax · joeygambino
Params33.1B
Context—
Smallest19.9 GB
WI
Wicked Tutu 26B A4B Final
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
PR
Prentis EQ 2
Prentis · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 27B Uncensored
Qwen · quuyy
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · gaianet
Params30.5B
Context256K
Q4_K_M18.6 GB
OR
Ornith 1.5 27B A3B Coder MTP
Ornith · ManniX-ITA
Params26.2B
Context256K
Q4_K_M16.1 GB
QW
Qwen3.8-27B
Qwen · igroc656
Params27.3B
Context256K
Q4_K_M16.6 GB
PR
PreciseCoder 27B GRPO 0.5F1
Precisecoder · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3 30B A3B Abliterated Erotic
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
SE
SenseNova U1.5 8B GGUFs
Sensenova · realrebelai
Params17.5B
Context—
Smallest9.3 GB
FL
flux model
Flux · licyk
Params11.9B
Context512
Q4_K_M2.9 GB
DA
datagemma rig 27b it IMat
Datagemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
LE
LeetCodeWizard 13B v1.1a i1
Leetcodewizard · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
QW
Qwen3.6 27B AEON Ultimate Uncensored
Qwen · Abiray
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen2.5 Coder 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3.8-27B
Qwen · AI-conn
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3 Coder 30B A3B Instruct Heretic
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
QwQ 32B
Qwen · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
RA
MS Raven 24B v1
Raven · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Gemma 3 12b It Vl Kimi V2 Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
CA
Carnice-V2-27B
Carnice · kai-os
Params27B
Context256K
Q4_K_M16.5 GB