Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
FL
Persephone Flux 2.0 Q8
Flux · pyys
Params11.9B
Context—
Smallest12.7 GB
GE
Gemma 4 31b It Heretic Ara
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MA
madlad400 10b mt
Madlad · google
Params10.7B
Context—
Smallest6.0 GB
QW
Qwen2.5 Coder 32B Instruct Uncensored i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3.8-27B GSQ-RCO
Qwen · Farggin
Params27.3B
Context256K
Smallest12.0 GB
AU
Augmental 13B v1.50 B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AL
Hy MT2 30B A3B
Alphazimuth · alphaZimuth
Params30B
Context256K
Smallest12.4 GB
QW
ThinkingCap Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
CO
ConfigurableSOLAR 10.7B i1
Configurablesolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Qwen3.6 27B Omnimerge v4
Qwen · ManniX-ITA
Params27B
Context256K
Q4_K_M16.5 GB
LL
UCCIX Llama2 13B i1
Llama · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
WA
WanT2IHighRealism2.2
Want · Kolso14
Params14.3B
Context—
Smallest15.4 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Notyourmom1
Params27B
Context256K
Q4_K_M18.0 GB
DE
DeepSeek V4.1 Flash ik llama
DeepSeek · pokey2025
Params14.2B
Context—
Smallest7.9 GB
GR
Groot 19B A3B 261023
Groot · GrootTeam
Params19B
Context256K
Q4_K_M11.7 GB
IN
INTELLECT 1 Instruct
Intellect · bartowski
Params10.2B
Context8K
Q4_K_M6.2 GB
GE
Gemma4 Gutenberg 31B Heretic
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
DA
MN Dark Horror The Cliffhanger 18.5B
Dark · DavidAU
Params18.5B
Context1000K
Q4_K_M11.2 GB
MU
Muse Glimmer 30B Uncensored Heretic
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
TE
Ternary Bonsai 2 27B Abliterated PTQ1 0 MTP Q4 0
Ternary · Cheurteen
Params26.9B
Context256K
Smallest5.9 GB
SE
Semancer 12B
Semancer · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
WA
Wan22nsfwenhanced
Wan · Cassanovason69
Params14.3B
Context—
Smallest15.4 GB
QW
Qwen3 Coder 30B A3B IT Heretic
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
HE
Hemmingway 1.5
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
FL
FLUX.1 Depth dev
Flux · SporkySporkness
Params11.9B
Context—
Smallest6.8 GB
NE
AceReason Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
AM
Amaretto 14B
Amaretto · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Mistral NeMo 12B Abliterated
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GE
Gemma 4 Ortenzya The Creative Wordsmith 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MU
Murasaki Backup
Murasaki · shoutmon
Params14.8B
Context32K
Smallest3.6 GB