Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
32B Qwen2.5 Kunou v1
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen3.8 27B Heretic JP Roleplay NSFW DanbooruTags
Qwen · EmilyOfOz
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
BA
bagel dpo 20b v04
Bagel · mradermacher
Params19.9B
Context32K
Q4_K_M12.7 GB
CodingRoleplayTool use
ZE
Zen Voyager
Zen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen2.5 Gutenberg Doppel 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
MO
MoNeuTrix MoE 4x7B
Moneutrix · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
GGUF
GE
Huihui Gemma 4 12B Agentic Fable5 Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningVision
WI
WizardMath 13B V1.0
Wizardmath · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.8 27B RANA Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
IN
Instella MoE 16B A3B Think
Instella · NANI-Nithin
Params15.9B
Context32K
Q4_K_M10.5 GB
Reasoning
RA
Radon 35B Ultra X RU
Radon · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
GGUF
LU
Luban 13B
Luban · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Simplicio 27B
Qwen · wesleysimplicio
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingVision
QW
Qwen3.8 27B Uncensored
Qwen · Guile
Params27.3B
Context256K
Q4_K_M17.8 GB
ReasoningTool useVision
GE
Gemma The Writer J.GutenBerg 10B
Gemma · DavidAU
Params10B
Context8K
Q4_K_M6.2 GB
Roleplay
ST
Stheno Inverted L2 13B
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GP
Gpt Oss 20b Tainted Heresy
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
DI
Dictalm-3.0-24B-Thinking
Dictalm · unsloth
Params23.6B
Context64K
Q4_K_M14.3 GB
Reasoning
TE
Tev 27B
Tev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
MI
Ministral-3-14B-Nymphaea-RP
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Roleplay
FL
FLUX.1 Krea dev
Flux · InvokeAI
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
QQ
qqWen 32B Pretrain
Qqwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen3.5 27B Uncensored Heretic v1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Huihui Qwen3.8 27B Coder390 EfficientThink abliterated VAL APEX I MiniPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Smallest14.2 GB
CodingReasoningVision
HO
Holo4 27B
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
NE
NVIDIA-Nemotron-3-Nano-Omni-30B-A3B
Nemotron · ggml-org
Params31.6B
Context1024K
Q4_K_M22.4 GB
ReasoningVision
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Roleplay
QW
Ternary Bonsai 2 27B Uncensored Heretic swift unc
Qwen · hotdogs
Params27B
Context256K
Smallest6.4 GB
ReasoningVision
HI
openaccess-ai-collective_hippogriff-30b-chat
Hippogriff · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF

Other sizes

Keep browsing