Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
32B Qwen2.5 Kunou v1
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3.8 27B Heretic JP Roleplay NSFW DanbooruTags
Qwen · EmilyOfOz
Params26.9B
Context256K
Q4_K_M16.5 GB
BA
bagel dpo 20b v04
Bagel · mradermacher
Params19.9B
Context32K
Q4_K_M12.7 GB
ZE
Zen Voyager
Zen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen2.5 Gutenberg Doppel 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
MO
MoNeuTrix MoE 4x7B
Moneutrix · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
GE
Huihui Gemma 4 12B Agentic Fable5 Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
WI
WizardMath 13B V1.0
Wizardmath · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.8 27B RANA Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
IN
Instella MoE 16B A3B Think
Instella · NANI-Nithin
Params15.9B
Context32K
Q4_K_M10.5 GB
RA
Radon 35B Ultra X RU
Radon · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
LU
Luban 13B
Luban · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Simplicio 27B
Qwen · wesleysimplicio
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Uncensored
Qwen · Guile
Params27.3B
Context256K
Q4_K_M17.8 GB
GE
Gemma The Writer J.GutenBerg 10B
Gemma · DavidAU
Params10B
Context8K
Q4_K_M6.2 GB
ST
Stheno Inverted L2 13B
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GP
Gpt Oss 20b Tainted Heresy
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
DI
Dictalm-3.0-24B-Thinking
Dictalm · unsloth
Params23.6B
Context64K
Q4_K_M14.3 GB
TE
Tev 27B
Tev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
Ministral-3-14B-Nymphaea-RP
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
FL
FLUX.1 Krea dev
Flux · InvokeAI
Params11.9B
Context—
Q4_K_M6.9 GB
QQ
qqWen 32B Pretrain
Qqwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3.5 27B Uncensored Heretic v1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Huihui Qwen3.8 27B Coder390 EfficientThink abliterated VAL APEX I MiniPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Smallest14.2 GB
HO
Holo4 27B
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
NE
NVIDIA-Nemotron-3-Nano-Omni-30B-A3B
Nemotron · ggml-org
Params31.6B
Context1024K
Q4_K_M22.4 GB
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Ternary Bonsai 2 27B Uncensored Heretic swift unc
Qwen · hotdogs
Params27B
Context256K
Smallest6.4 GB
HI
openaccess-ai-collective_hippogriff-30b-chat
Hippogriff · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB