Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
HU
HunyuanVideo
Hunyuanvideo · city96
Params12.8B
Context—
Q4_K_M7.9 GB
WI
Wicked Tutu 31B Final
Wicked · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
SE
Serenity 26B A4B
Serenity · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
KI
MythoMax L2 Kimiko v2 13B
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Dongfangshuo Qwen3.8 27B NSFW Novel
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
RO
Rocinante 12B v1.1
Rocinante · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
RA
Rainbow AI 12B Unified
Rainbow · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
IN
Ingot IV 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest5.9 GB
RO
Rocinante 12B v1.1
Rocinante · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
WA
Wan2.2 VACE Fun A14B NSFW Merge
Wan · PineAmbassador
Params17.3B
Context—
Q4_K_M11.6 GB
GE
Gemma 4 26B A4B StyleTune V2
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
LL
Phind CodeLlama 34B v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
QW
Qwen3 14B Abliterated
Qwen · AIgotahole
Params14.8B
Context40K
Smallest8.6 GB
ER
Ernie-4.5-21B-A3B-Thinking
Ernie · unsloth
Params21.8B
Context128K
Q4_K_M13.3 GB
QW
Qwen2.5 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
FI
FireRed Image Edit 1.1 ComfyUI
Firered · FireRedTeam
Params20.4B
Context—
Q4_K_M13.1 GB
QW
Qwen3.5 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
BL
Q3.5 BlueStar 27B
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
GE
Gemma 4 31b Novel Merged
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MY
Mythical Destroyer V2 L2 13B
Mythical · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Dongfangshuo Qwen3.8 27B NSFW
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Nz Gemma4 12B LTX25
Gemma · Rootport
Params13.1B
Context—
Q4_K_M9.2 GB
MI
Abliterated Dolphin3.0 R1 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen3.8 27B Heretic
Qwen · darrellbest
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 12B EsperGrug
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3.8 27B Med Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GE
Gemma 3 12b It Heretic
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
Skyfall 31B v4.2
Mistral · TheDrummer
Params31.4B
Context128K
Q4_K_M19.0 GB
QW
Qwen3.8 27B Max Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB