Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · bartowski
Params12.8B
Context128K
Q4_K_M7.9 GB
GGUF
GE
gemma-4-31B-it-uncensored-heretic
Gemma · JMingo
Params30.7B
Context256K
Q4_K_M18.3 GB
GGUF
AL
Alpacino30b i1
Alpacino · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
NE
nvidia OpenCodeReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoning
MI
Mistral-11B-SynthIAirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
LL
LLaDa Image ComfyUI
Llada · realrebelai
Params16.3B
Context—
Q4_K_M9.2 GB
GGUF
QW
Qwen2.5 14B Instruct
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
HY
MN 12B Hydra RP RU
Hydra · limloop
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
CY
CyberOss 2.0 20B i1
Cyberpal · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
LL
CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
DA
DaringMaid 13B
Daringmaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Rombo LLM V3.0 Qwen 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
AY
Aya Expanse 32b
Aya · bartowski
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
RE
Reka Flash 3
Reka · DavidAU
Params21B
Context32K
Q4_K_M14.3 GB
ReasoningRoleplayTool use
MI
MiLMMT 46 12B v1.0
Milmmt · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
QW
Hemlock Qwen2.5 Coder 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
GE
gemma-4-12B
Gemma · ggml-org
Params11.9B
Context256K
Smallest12.7 GB
GGUF
QW
Qwopus3.6 27B v1 Preview
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
GE
gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled
Gemma · Abiray
Params30.7B
Context256K
Q4_K_M18.7 GB
Reasoning
LA
adaptllm_law-llm-13b
Law · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NE
Nemomix v3.0 12B i1
Nemomix · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GL
Glm-4.7-Flash
GLM · bloopez
Params30B
Context198K
Smallest59.9 GB
GGUF
QW
DAU_Qwen3.6_27B_H2_FT
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
QW
Qwen3.8 27B Heretic Dynamic
Qwen · ajgazin
Params27.3B
Context256K
Smallest17.6 GB
Vision
RO
MN RocinanteCelestar 12B i1
Rocinantecelestar · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
MixTAO 7Bx2 MoE v8.1
Mixtao · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
JO
JoyFox-Reverie-27B
Joyfox · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
WI
WizardLM 2 4x7B MoE
Wizardlm · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
WI
Wicked Tutu 31B
Wicked · ReadyArt
Params30.7B
Context256K
Q4_K_M20.3 GB
Roleplay
OM
Omega Evolution 26B A4B v3.0
Omega · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay

Other sizes

Keep browsing