Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · bartowski
Params12.8B
Context128K
Q4_K_M7.9 GB
GE
gemma-4-31B-it-uncensored-heretic
Gemma · JMingo
Params30.7B
Context256K
Q4_K_M18.3 GB
AL
Alpacino30b i1
Alpacino · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
NE
nvidia OpenCodeReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
MI
Mistral-11B-SynthIAirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
LL
LLaDa Image ComfyUI
Llada · realrebelai
Params16.3B
Context—
Q4_K_M9.2 GB
QW
Qwen2.5 14B Instruct
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
HY
MN 12B Hydra RP RU
Hydra · limloop
Params12.2B
Context1000K
Q4_K_M7.5 GB
CY
CyberOss 2.0 20B i1
Cyberpal · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
LL
CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
DA
DaringMaid 13B
Daringmaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Rombo LLM V3.0 Qwen 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
AY
Aya Expanse 32b
Aya · bartowski
Params32.3B
Context8K
Q4_K_M19.8 GB
RE
Reka Flash 3
Reka · DavidAU
Params21B
Context32K
Q4_K_M14.3 GB
MI
MiLMMT 46 12B v1.0
Milmmt · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Hemlock Qwen2.5 Coder 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GE
gemma-4-12B
Gemma · ggml-org
Params11.9B
Context256K
Smallest12.7 GB
QW
Qwopus3.6 27B v1 Preview
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GE
gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled
Gemma · Abiray
Params30.7B
Context256K
Q4_K_M18.7 GB
LA
adaptllm_law-llm-13b
Law · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
NE
Nemomix v3.0 12B i1
Nemomix · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GL
Glm-4.7-Flash
GLM · bloopez
Params30B
Context198K
Smallest59.9 GB
QW
DAU_Qwen3.6_27B_H2_FT
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 27B Heretic Dynamic
Qwen · ajgazin
Params27.3B
Context256K
Smallest17.6 GB
RO
MN RocinanteCelestar 12B i1
Rocinantecelestar · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
MixTAO 7Bx2 MoE v8.1
Mixtao · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
JO
JoyFox-Reverie-27B
Joyfox · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
WI
WizardLM 2 4x7B MoE
Wizardlm · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
WI
Wicked Tutu 31B
Wicked · ReadyArt
Params30.7B
Context256K
Q4_K_M20.3 GB
OM
Omega Evolution 26B A4B v3.0
Omega · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB