Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
HU
HunyuanVideo
Hunyuanvideo · city96
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
WI
Wicked Tutu 31B Final
Wicked · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
SE
Serenity 26B A4B
Serenity · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
KI
MythoMax L2 Kimiko v2 13B
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Dongfangshuo Qwen3.8 27B NSFW Novel
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
RO
Rocinante 12B v1.1
Rocinante · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
RA
Rainbow AI 12B Unified
Rainbow · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
IN
Ingot IV 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest5.9 GB
ReasoningTool use
RO
Rocinante 12B v1.1
Rocinante · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
WA
Wan2.2 VACE Fun A14B NSFW Merge
Wan · PineAmbassador
Params17.3B
Context—
Q4_K_M11.6 GB
GGUF
GE
Gemma 4 26B A4B StyleTune V2
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
LL
Phind CodeLlama 34B v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
QW
Qwen3 14B Abliterated
Qwen · AIgotahole
Params14.8B
Context40K
Smallest8.6 GB
ReasoningTool use
ER
Ernie-4.5-21B-A3B-Thinking
Ernie · unsloth
Params21.8B
Context128K
Q4_K_M13.3 GB
Reasoning
QW
Qwen2.5 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
FI
FireRed Image Edit 1.1 ComfyUI
Firered · FireRedTeam
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
QW
Qwen3.5 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
BL
Q3.5 BlueStar 27B
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
GE
Gemma 4 31b Novel Merged
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
MY
Mythical Destroyer V2 L2 13B
Mythical · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Dongfangshuo Qwen3.8 27B NSFW
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
GE
Nz Gemma4 12B LTX25
Gemma · Rootport
Params13.1B
Context—
Q4_K_M9.2 GB
GGUF
MI
Abliterated Dolphin3.0 R1 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
QW
Qwen3.8 27B Heretic
Qwen · darrellbest
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma 4 12B EsperGrug
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Reasoning
QW
Qwen3.8 27B Med Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 12b It Heretic
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
MI
Skyfall 31B v4.2
Mistral · TheDrummer
Params31.4B
Context128K
Q4_K_M19.0 GB
Reasoning
QW
Qwen3.8 27B Max Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF

Other sizes

Keep browsing