Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Virtuoso Medium
Qwen · arcee-ai
Params32.8B
Context128K
Q4_K_M19.8 GB
MA
Magidonia 24B v4.3 Absolute Heresy
Magidonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.5 27B Uncensored RYS Reasoner
Qwen · jackasda211233
Params29.9B
Context256K
Smallest17.2 GB
MA
Marvin TheGrumpyOldAssistant 13B HF
Marvin · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
MU
Muse Glimmer 30B CRACK Fp16
Muse · dealignai
Params27.9B
Context128K
Q4_K_M16.9 GB
GL
Glm-Z1-32B-0414
GLM · unsloth
Params32.6B
Context32K
Q4_K_M19.7 GB
QW
Qwen3.5 27B Uncensored
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
MI
Mixtral 11Bx2 MoE 19B
Mistral · TheBloke
Params19.2B
Context4K
Q4_K_M10.9 GB
GE
gemma-4-12B-it
Gemma · Mungert
Params11.9B
Context256K
Q4_K_M7.7 GB
BE
Bernini R
Bernini · neuregex
Params14.3B
Context—
Q4_K_M9.7 GB
QW
Swift 1.5 Qwen3.8 27B PXQN OneCard
Qwen · poisonxa
Params27.3B
Context256K
Smallest13.6 GB
QW
Qwen3.8 Queen 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
JA
L3 Grand Story Darkness MOE 4X8 24.9B e32
Jamet · DavidAU
Params24.9B
Context8K
Q4_K_M15.4 GB
FE
Feyospace S1 OBLITERATED
Feyospace · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
KI
Kitchoon V2 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
QW
Qwen3.8-27B
Qwen · Fix-AI
Params27.3B
Context256K
Q4_K_M16.5 GB
LU
Lumimaid Magnum 12B
Lumimaid · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
TO
Torchcast Decision 27b
Torchcast · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
FL
FLUX.1 Fill dev
Flux · SporkySporkness
Params11.9B
Context—
Smallest6.8 GB
CO
CorX3.8 27B
Corx · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Ternary Bonsai 2 27B gguf etheroi
Qwen · developerjeremylive
Params27B
Context256K
Smallest5.9 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
OR
Ornith 1.5 27B A3B CoderX
Ornith · mradermacher
Params26.2B
Context256K
Q4_K_M16.1 GB
CA
CarbonBeagle 11B
Carbonbeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
QW
Qwen2.5 32B Instruct CFT
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
PH
Phi-4-Reasoning
Phi · unsloth
Params14.7B
Context32K
Q4_K_M9.1 GB
LT
LTX 2.5 22B dev uncensored ROCmFPX
Ltx · Harsha001
Params13.1B
Context—
Smallest14.7 GB
QW
Qwen3 VL 32B Instruct Abliterated v1
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
PA
janhq_pandora-v1-13b
Pandora · TheBloke
Params12.5B
Context32K
Q4_K_M7.5 GB