Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 27B Heretic Uncensored Q6 K
Qwen · mlasli
Params27.3B
Context256K
Smallest22.5 GB
WA
Wan Dancer GGUFs
Wan · realrebelai
Params17.2B
Context—
Q4_K_M12.5 GB
MU
Muse Glimmer 30B uncensored
Muse · TrevorJS
Params28B
Context128K
Q4_K_M16.9 GB
GP
Huihui gpt oss 20b abliterated v2 MXFP4 MOE
gpt-oss · noctrex
Params20.9B
Context128K
Smallest12.1 GB
QW
Qwen3.8 27B TQ
Qwen · YTan2000
Params27.3B
Context256K
Smallest0.8 GB
MI
Mixtral_7Bx2_MoE_13B
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
ST
StarCoder
StarCoder · mradermacher
Params15.5B
Context8K
Q4_K_M10.0 GB
BO
Boulesis v2.1 26B A4B HeadTune
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
Gemma 4 12B It Uncensored Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
MI
ANITA NEXT 24B Dolphin Mistral UNCENSORED ITA
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
QW
Swift 1.5 Qwen3.8 27b Heretic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
DE
MultiPL-T-DeepSeekCoder_33b
DeepSeek · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
AU
Aura Prototype 26B A4B
Aura · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
WI
ehartford_wizard-vicuna-30b-uncensored
Wizard · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GE
Gemopus 4 26B A4B it Preview APEX
Gemopus · mudler
Params25.2B
Context256K
Smallest13.0 GB
LF
LFM2.5-24B-A2B-Preview
Lfm · AtomicChat
Params24B
Context128K
Q4_K_M15.4 GB
GR
Granite 20b Code Instruct
Granite · legraphista
Params20B
Context8K
Smallest4.5 GB
WA
Wan Move 14B 480P
Wan · vantagewithai
Params16.4B
Context—
Q4_K_M11.3 GB
NE
Nemomix v4.0 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
openassistant_llama2-13b-orca-8k-3319
Llama · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
WI
Wicked Stuff 26B A4B v3.0 Final
Wicked · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
NE
NVIDIA Nemotron 3 Nano 30B A3B
Nemotron · lmstudio-community
Params31.6B
Context1024K
Q4_K_M24.5 GB
LL
ehartford_samantha-1.11-codellama-34b
Llama · TheBloke
Params33.7B
Context2K
Q4_K_M20.2 GB
GE
Gemma 4 26B A4B It Abliterated
Gemma · SevenOfNine
Params25.2B
Context256K
Smallest19.1 GB
QW
Huihui Qwen3.5 27B Abliterated
Qwen · HeYujie
Params27B
Context256K
Q4_K_M16.5 GB
LF
LFM2.5-24B-A2B
Lfm · ggml-org
Params24B
Context128K
Q4_K_M14.5 GB
MI
Mistral Nemo Inst 2407 12B Thinking Uncensored HERETIC HI Claude Opus
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
LightGPT 13B Llama2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LF
LFM2.5 24B A2B Uncensored GSQ RCO
Lfm · abenzerps
Params24B
Context128K
Smallest0.4 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB