Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
SY
Synthia v3.0 11B
Synthia · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
Ministral 3 14B Nymphaea RP
Mistral · 0xA50C1A1
Params13.5B
Context—
Smallest0.0 GB
MI
Ministral 3 14B Instruct 2512 Absolute Heresy
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MO
MoNeuTrix MoE 4x7B i1
Moneutrix · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
QW
ElisNovel V3 32B
Qwen · cyanelis
Params32.8B
Context40K
Q4_K_M19.8 GB
HU
Xing4.0 29B A4B APEX I MiniPlus V2.1 Abliterated
Huihui · IsValorum
Params31.2B
Context256K
Smallest13.8 GB
QW
Qwen Qwen3 32B Heretic
Qwen · ThalisAI
Params32.8B
Context40K
Q4_K_M19.8 GB
GO
Goetia 26B A4B v1.7
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
QW
Qwen3 32B VL Instruct Polaris HI16 Heretic Uncensored
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
Qwen3.8 27B Cold Fusion GAIN V1.1 NVFP4
Qwen · esatapedico
Params27.3B
Context256K
Smallest14.9 GB
CR
Crimson_Dawn v0.2 Base
Crimson · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Gemma 4 12B Coder Fable5 Composer2.5 v1 Uncensored Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
gemma 4 31B it Mystery Fine Tune HERETIC UNCENSORED Thinking Instruct
Gemma · DavidAU
Params30.7B
Context256K
Smallest17.8 GB
QW
Qwen3-32B-128K
Qwen · unsloth
Params32.8B
Context128K
Q4_K_M19.8 GB
PR
prometheus 13B v1.0
Prometheus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SA
sarvam 30b GGUF IQ2 M IQ1 M
Sarvam · Aaravomega
Params32.2B
Context128K
Smallest7.9 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · robertbschuette
Params27B
Context256K
Q4_K_M18.0 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Code-Gen
Params26.9B
Context256K
Q4_K_M18.0 GB
MI
Minimax h3 Singularity V2 Pruned
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
SK
Sky T1 32B Flash
Sky · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
AP
Apriel 1.5 15b Thinker
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
TE
Bonsai 27b Ternary CRACK
Ternary · dealignai
Params27B
Context256K
Smallest8.2 GB
QW
Qwen2.5 Wolverine CODER 11B V2 128k Ctx
Qwen · mradermacher
Params10.9B
Context128K
Q4_K_M6.6 GB
DI
DiscoveryRSI 27B
Discoveryrsi · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
NO
nousresearch_nous-hermes-13b
Nous · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
QW
Qwopus3.8 27B Flash V2 Abliterated
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
TE
TeaAI Nemo 12B
Teaai · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
QW
Qwen3.8 27B
Qwen · zugquants
Params26.9B
Context256K
Q4_K_M16.5 GB
CO
CodeUp Alpha 13B HF
Codeup · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
WA
wan s2v
Wan · calcuis
Params16.3B
Context—
Q4_K_M13.9 GB