Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
IN
Internlm2_5 20b Chat
InternLM · bartowski
Params19.9B
Context32K
Q4_K_M12.0 GB
QW
Qwen3.8 27B OBLITERATED22 AGENT
Qwen · shoukewei
Params27.3B
Context256K
Q4_K_M16.8 GB
DE
DeepSeek V2 Lite Chat Uncensored Unbiased Reasoner
DeepSeek · mradermacher
Params15.7B
Context4K
Q4_K_M10.4 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · TTPPCC121
Params27B
Context256K
Q4_K_M18.0 GB
GE
Huihui Gemma 4 12B It Abliterated
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
MY
MythoLogic L2 13B
Mythologic · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
DA
datagemma rig 27b it
Datagemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
ME
mera mix 4x7B i1
Mera · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GP
Gpt Oss 20b Uncensored Heretic
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
BO
NbAiLab/borealis2-26b-a4b-preview
Borealis · NbAiLab
Params25.2B
Context256K
Q4_K_M16.8 GB
SA
Saltware-solar-10.7b-v1.0
Saltware · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llama 3.2 8X3B GATED MOE Horror Reasoning Dark Champion uncensored 18.4B IMAT
Llama · DavidAU
Params18.4B
Context128K
Q4_K_M11.8 GB
JE
Sakura Humanlike Chat 2.0 JEV AutoRound
Jev · webmp3
Params27.3B
Context256K
Smallest13.5 GB
WA
Wan2.1 Fun 14B Control
Wan · city96
Params16.4B
Context—
Q4_K_M10.9 GB
QW
Ektome Qwen3 30B A3B PristinelyUncensored
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.5 24B A3B Claude Opus Gemini 3.1 Pro Reasoning Distilled Heretic
Qwen · mradermacher
Params24.5B
Context256K
Q4_K_M15.0 GB
MI
Mistral Small 3.2 24B Instruct 2506 Ultra Uncensored Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Gemma 4 Garnet V2 31B It Ultra Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
SW
Swallow-13b-instruct-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · mradermacher
Params22.2B
Context64K
Q4_K_M13.3 GB
RU
MN 12B Runeweaver RP RU
Runeweaver · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
TR
Trinity Mini
Trinity · bartowski
Params26B
Context128K
Q4_K_M15.9 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen3.8 27B MindMeld OneJev1.6
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5 27B Writer V2 Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
Magistral Small 2507
Mistral · bartowski
Params23.6B
Context40K
Q4_K_M14.3 GB
PY
Pygmalion 2 13B SuperCOT
Pygmalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
PO
Polaris VGA 27B Post1.0e
Polaris · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GE
Amoral Gemma3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
ST
Starcoderbase
StarCoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB