Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
GL
GLM 4.7 Flash Claude Opus 4.5 High Reasoning Distill
GLM · TeichAI
Params30B
Context198K
Q4_K_M18.1 GB
GR
Granite 20b Code Base R1.1
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
GE
Gemma 4 26B A4B It Heretic
Gemma · nohurry
Params25.2B
Context256K
Q4_K_M16.9 GB
WI
WizardCoder 15B V1.0 i1
Wizardcoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
WI
Wicked Stuff 12B
Wicked · ReadyArt
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 4 31B Abliterated Uncensored
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Kataguru Qwen3.8 27B Titan v3.2
Qwen · kataguru
Params26.9B
Context256K
Smallest11.2 GB
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · mradermacher
Params10.7B
Context16K
Q4_K_M6.5 GB
MU
Muse-Glimmer-30B-Hermes-Agentic
Muse · vcruz305
Params27.9B
Context128K
Q4_K_M16.9 GB
QW
Qwen3.8 Whittle MoE 27B A17.8B
Qwen · mradermacher
Params27B
Context256K
Q4_K_M17.4 GB
QW
Qwen3.8 27B Humanlike Chat 2.0
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
SE
SenseNova 6.8 Code2Video MTP
Sensenova · Abiray
Params27.3B
Context256K
Q4_K_M18.5 GB
QW
Qwen3.8 27B Uncensored
Qwen · jaromer
Params27.3B
Context256K
Q4_K_M16.5 GB
MA
openaccess-ai-collective_manticore-13b-chat-pyg
Manticore · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · ggml-org
Params30.5B
Context256K
Smallest32.5 GB
GR
Granite 34b Code Base 8k
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
QW
MiroThinker-v1.5-30B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
QW
Qwen3.8 27B Uncensored FP8
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
FO
foundational models
Foundational · sagalore-softworks
Params11.9B
Context256K
Smallest1.1 GB
QW
Qwen3.8-27B
Qwen · jakeatx
Params27.3B
Context256K
Smallest15.6 GB
QW
Qwen3 30B A3B Architect18
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
CA
CausalLM 14B DPO alpha
Causallm · tastypear
Params14.2B
Context8K
Q4_K_M9.2 GB
GL
Glitter_Boy 2.0
Glitter · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
PA
MS3.2 PaintedFantasy v4 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Gemma 4 26b A4B Heretic Styletune v2 Head
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
FI
Final Order 24B
Final · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Gemma 4 12B Unified System One
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
qwen3 coder 30b a3b compacted 19b 256k
Qwen · continuum-ai
Params19.7B
Context256K
Q4_K_M12.0 GB
ST
G4 Starry Ocean 12B Heretic
Starry · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3.8 27B Uncensored Chinese
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB