Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
RE
Reka Flash 3
Reka · bartowski
Params21B
Context32K
Q4_K_M13.6 GB
PL
Plamo 2 Translate
Plamo · mmnga
Params9.53B
Context10240K
Smallest4.6 GB
QW
Zhi Create Qwen3 32B
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
VellumMini 0.1 Qwen3 14B
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
ThinkingCap Qwen3.6 27B Heretic
Qwen · egibson
Params27B
Context256K
Q4_K_M16.5 GB
EL
Elysium2.1-11b
Elysium · mradermacher
Params11.2B
Context32K
Q4_K_M6.7 GB
MS
MSM MS Cydrion 22B
Msm · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
LF
LFM2.5-24B-A2B
Lfm · IsValorum
Params24B
Context128K
Smallest9.6 GB
GE
Gemma 3 12b It Vl HighIQ Polaris Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GP
gpt oss 20b abliterated
gpt-oss · wangzhang
Params21B
Context128K
Q4_K_M15.8 GB
MI
Huihui Devstral Small 2 24B Instruct 2512 Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
GE
Gemma 4 31B It Uncensored Heretic v2
Gemma · lactroiii
Params30.7B
Context256K
Smallest25.2 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Cdimabusinessent
Params27B
Context256K
Q4_K_M18.0 GB
VE
Veritas 12B
Veritas · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
CH
Chocolatine 14B Instruct 4k DPO i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GE
gemma-4-31B-it
Gemma · Mungert
Params30.7B
Context256K
Q4_K_M19.3 GB
GE
Gemma 4 Gembrain X Core 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
EQ
Equinox 31B
Equinox · LatitudeGames
Params30.7B
Context256K
Q4_K_M18.7 GB
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Swift 1.5 Qwen3.8 27b
Qwen · br1nz
Params27B
Context256K
Smallest10.9 GB
GE
Gemma 4 Gembrain 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Rombos LLM V2.6 Qwen 14b
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen3 14B Heretic
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwopus GLM 18B Merged
Qwen · Jackrong
Params15.9B
Context256K
Q4_K_M9.8 GB
CO
CodeV SVA 14B
Codev · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ME
Melody1437 26B A4B
Melody · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GL
GLM 4.7 Flash REAP 23B A3B absolute heresy
GLM · MuXodious
Params23B
Context198K
Q4_K_M13.9 GB
QW
Qwen3.5 27B uncensored heretic v1
Qwen · llmfan46
Params27B
Context256K
Q4_K_M16.5 GB
DE
DeepSeek V4.1 Flash DSpark
DeepSeek · Lucebox
Params14.2B
Context—
Smallest4.9 GB
GE
Huihui Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB