Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
NO
Noromaid 13B v0.2
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GE
Gemma 4 12B It QAT SOMPOA Heresy
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
LF
Lfm25 24b
Lfm · PollardWeights
Params24B
Context128K
Smallest5.8 GB
GE
Coder3101_Gemma_4_31B_It_Heretic
Gemma · Stabhappy
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 26B A4B QAT Voice GGUFs
Gemma · alexisStacksCode
Params25.2B
Context128K
Smallest0.3 GB
MI
Mistral Military 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
OR
Orca 2 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
PA
Pantheon Reasoning 26B A4B 1.1
Pantheon · bartowski
Params26B
Context256K
Q4_K_M17.5 GB
MI
Ministral 3 14B Instruct 2512 BF16
Mistral · EnlistedGhost
Params13.5B
Context256K
Q4_K_M8.8 GB
GE
Huihui Gemma 4 12B Coder Fable5 Composer2.5 v1 Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
BiggerCoQ Qwen3 10b
Qwen · mradermacher
Params10.9B
Context40K
Q4_K_M6.6 GB
SI
InnerJev 27B Full
Sii · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
SU
SuperNova Medius
Supernova · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
Fallen Gemma3 12B v1
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
VI
MN Violet Lotus 12B
Violet · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GE
Gemma 4 MoonGem 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ZE
ZeusLabs Chronos Divergence 33B
Zeuslabs · RichardErkhov
Params32.5B
Context16K
Q4_K_M19.6 GB
MX
MXLewd L2 20B
Mxlewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
NU
Nu 17b
mradermacher
Params16.8B
Context32K
Q4_K_M10.3 GB
GL
Q3.6 27B GLM 5.1 DA
GLM · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
UP
upstage SOLAR 10.7B Instruct v1.0
Upstage · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GE
Gemma 4 12B It Qat Q4_0 Unquantized Heretic v1.1
Gemma · igorls
Params11.9B
Context256K
Smallest7.0 GB
LL
Llama 3 13B Instruct v0.1
Llama · MaziyarPanahi
Params13.3B
Context8K
Q4_K_M8.1 GB
SK
SkyReels V2 T2V 14B 720P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
QW
Qwen2.5 Wolverine CODER 11B V2
Qwen · mradermacher
Params10.9B
Context32K
Q4_K_M6.6 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · TopherAU
Params27B
Context256K
Q4_K_M18.0 GB
GE
Gemma4 Gutenberg Literotica 12B
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 2 27b It
Gemma · ThomasBaruzier
Params27.2B
Context8K
Q4_K_M16.6 GB
BI
Bielik 11B v2.2 Instruct
Bielik · bartowski
Params11.2B
Context32K
Q4_K_M6.7 GB
GR
Granite 20b Code Instruct 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB