Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Virtuoso Medium
Qwen · arcee-ai
Params32.8B
Context128K
Q4_K_M19.8 GB
GGUF
MA
Magidonia 24B v4.3 Absolute Heresy
Magidonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
QW
Qwen3.5 27B Uncensored RYS Reasoner
Qwen · jackasda211233
Params29.9B
Context256K
Smallest17.2 GB
ReasoningTool use
MA
Marvin TheGrumpyOldAssistant 13B HF
Marvin · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MU
Muse Glimmer 30B CRACK Fp16
Muse · dealignai
Params27.9B
Context128K
Q4_K_M16.9 GB
ReasoningTool useVision
GL
Glm-Z1-32B-0414
GLM · unsloth
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
QW
Qwen3.5 27B Uncensored
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
MI
Mixtral 11Bx2 MoE 19B
Mistral · TheBloke
Params19.2B
Context4K
Q4_K_M10.9 GB
GGUF
GE
gemma-4-12B-it
Gemma · Mungert
Params11.9B
Context256K
Q4_K_M7.7 GB
GGUF
BE
Bernini R
Bernini · neuregex
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
QW
Swift 1.5 Qwen3.8 27B PXQN OneCard
Qwen · poisonxa
Params27.3B
Context256K
Smallest13.6 GB
GGUF
QW
Qwen3.8 Queen 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
JA
L3 Grand Story Darkness MOE 4X8 24.9B e32
Jamet · DavidAU
Params24.9B
Context8K
Q4_K_M15.4 GB
Roleplay
FE
Feyospace S1 OBLITERATED
Feyospace · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
KI
Kitchoon V2 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
QW
Qwen3.8-27B
Qwen · Fix-AI
Params27.3B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
LU
Lumimaid Magnum 12B
Lumimaid · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TO
Torchcast Decision 27b
Torchcast · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
FL
FLUX.1 Fill dev
Flux · SporkySporkness
Params11.9B
Context—
Smallest6.8 GB
GGUF
CO
CorX3.8 27B
Corx · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
QW
Ternary Bonsai 2 27B gguf etheroi
Qwen · developerjeremylive
Params27B
Context256K
Smallest5.9 GB
Vision
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
OR
Ornith 1.5 27B A3B CoderX
Ornith · mradermacher
Params26.2B
Context256K
Q4_K_M16.1 GB
Coding
CA
CarbonBeagle 11B
Carbonbeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
QW
Qwen2.5 32B Instruct CFT
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
PH
Phi-4-Reasoning
Phi · unsloth
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
LT
LTX 2.5 22B dev uncensored ROCmFPX
Ltx · Harsha001
Params13.1B
Context—
Smallest14.7 GB
GGUF
QW
Qwen3 VL 32B Instruct Abliterated v1
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
QW
Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
PA
janhq_pandora-v1-13b
Pandora · TheBloke
Params12.5B
Context32K
Q4_K_M7.5 GB
GGUF

Other sizes

Keep browsing