Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen3 14B Abliterated Conservative
Qwen · richardyoung
Params14.8B
Context40K
Q4_K_M9.0 GB
HO
Holo4 27B
Holo · Hcompany
Params27B
Context256K
Q4_K_M16.9 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · AtomicChat
Params32.9B
Context1024K
Q4_K_M25.0 GB
LL
testmod koen llama2 13b dpotrain testver
Llama · RichardErkhov
Params13B
Context—
Q4_K_M0.0 GB
QW
Qwen2.5 Coder 32b Instruct Heretic Sft
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
KR
krea 2
Krea · gguf-org
Params12.8B
Context—
Smallest0.3 GB
QW
Qwen3.6 35B A3b pruned v2
Qwen · gatilin
Params26.6B
Context256K
Smallest16.3 GB
QW
Huihui Qwen3 VL 30B A3B Instruct Abliterated
Qwen · noctrex
Params30.5B
Context256K
Q4_K_M18.6 GB
AR
BAAI AREX 2
Arex · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
QW
Qwen3.8 Whittle MoE 27B A17.8B
Qwen · logic65
Params26.9B
Context256K
Q4_K_M17.4 GB
QW
Qwen3.8 27B Heretic JP Roleplay NSFW
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
KR
Krea 2 Turbo
Krea · byteshape
Params12.8B
Context—
Q4_K_M7.9 GB
WA
Wan2.2 T2V A14B
Wan · bullerwins
Params14.3B
Context—
Q4_K_M9.7 GB
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 128k 30B A3B NEO MAX Imatrix
Qwen · DavidAU
Params30.5B
Context128K
Q4_K_M18.6 GB
QW
Qwen3 14B Abliterated
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Therapy 3.8
Qwen · Verdugie
Params26.9B
Context256K
Q4_K_M16.5 GB
GI
GigaChat3.1 10B A1.8B
Gigachat · ai-sage
Params10.7B
Context256K
Q4_K_M6.5 GB
KI
Kitchoon V3 26B A4B
Kitchoon · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled v2
Qwen · Jackrong
Params27B
Context256K
Q4_K_M16.5 GB
JE
JEV 27B VL
Jev · Atlas3D
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3 30B A3B
Qwen · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
ST
StartLux-Decision-v1.1-27B-Instant
Startlux · startlux-models
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8-27B-DFlash2
Qwen · perplexity-ai
Params27.3B
Context256K
Q4_K_M1.1 GB
TE
Test Frankenstein
Test · ND911
Params11.9B
Context—
Smallest6.9 GB
GE
Gemma 3 12b It
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Sprinkle Gemma 4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.8
Qwen · cHunter789
Params27B
Context256K
Smallest14.8 GB
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB