Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
LL
LLaMA2-13B-Psyfighter2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GE
Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
GEV 26B Decide
Gev · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
CH
Chaotic Harmony 24B
Chaotic · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
OP
OpenOrca Platypus2 13B
Openorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TE
TerminalHorizon 27B
Terminalhorizon · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GE
Gemma 4 26B A4B StyleTune QK Heretic
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
burtenshaw GemmaCoder3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
ON
OneJev 27B
Onejev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
LL
Llama 30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
YO
You can cry Snowman 13B
You · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
GE
Gemma 4 Garnet V2 31B It Ultra Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
LY
MN 12B Lyra v4
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
HU
hyvid
Hunyuanvideo · calcuis
Params12.8B
Context—
Q4_K_M7.9 GB
WR
writing roleplay 20k context nemo 12b v1.0
Writing · openerotica
Params12.2B
Context1000K
Q4_K_M7.5 GB
GR
Grug 27b v1.1
Grug · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
GP
Gpt Oss 20b Derestricted
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
SL
SlimOrca 13B
Slimorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GE
gemma 4 12B it Claude 4.6 4.8 Opus
Gemma · yuxinlu1
Params11.9B
Context128K
Q4_K_M7.4 GB
MI
MiniMax H3 GGUF MiniStack
Minimax · woodfireind
Params20.1B
Context256K
Q4_K_M2.5 GB
LL
Llama3.2 24B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored
Llama · mradermacher
Params18B
Context128K
Q4_K_M11.1 GB
QW
Qwen3.8 27B
Qwen · zugquants
Params26.9B
Context256K
Q4_K_M16.5 GB
OM
OmniDimen 2 20B Emotion
Omnidimen · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
AT
Athena v4 i1
Athena · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
AI
Airolima Chronos Grad L2 13B
Airolima · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
RP
rpguild chatml 13B
Rpguild · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ME
merlyn education corpus qa v2
Merlyn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
FA
Falcon3 10B Instruct Abliterated
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB