Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
qwen3.8 27b abliterated 3.69bpw 12GB MTP
Qwen · soyaakinohara
Params27.3B
Context256K
Smallest12.6 GB
QW
Qwen3 VL 32B Instruct
Qwen · bartowski
Params32.8B
Context256K
Q4_K_M19.8 GB
VI
MN Violet Lotus 12B
Violet · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
OM
Omega Arsenal 12B
Omega · ReadyArt
Params11.9B
Context256K
Q4_K_M7.4 GB
OP
OpenJev
Openjev · ggml-org
Params27B
Context256K
Q4_K_M19.4 GB
QW
Qwen3 30B A3B Abliterated Erotic
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
GE
Gemma-4-26B-A4B-It
Gemma · mudler
Params25.2B
Context256K
Smallest9.5 GB
TE
Ternary Bonsai 2 27B 262k
Ternary · CaryPalmer
Params27.3B
Context256K
Smallest6.4 GB
GO
Goetia 26B A4B v1.7
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
LF
LFM2.5-24B-A2B
Lfm · NANI-Nithin
Params24B
Context128K
Q4_K_M14.5 GB
GE
Gemma 4 Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
DE
DeepSeek-V2-Lite
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
QW
Qwen2.5 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Ingot XV 27B Q2
Qwen · dendriteholdings
Params26.9B
Context256K
Smallest5.9 GB
ME
Melody1437 26B A4B v2.0
Melody · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Uncensored Chinese
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
MiniMax H3 Singularity
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GE
Gemma 4 31B It Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
LL
Llama 3.2 11B Vision Instruct
Llama · leafspark
Params9.78B
Context128K
Q4_K_M6.0 GB
QW
Qwen2.5 VL 32B Instruct Unredacted MAX
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
Qwen3.8 27B Uncensored Heretic Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
DE
DeepSeek Coder V2 Lite Instruct Abliterated
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GL
Huihui GLM 4.7 Flash Abliterated
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
FL
FluxDev8AnimeNsfw
Fluxdev · Zuntan
Params11.9B
Context—
Smallest6.8 GB
IN
Ingot XII 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest5.9 GB
QW
Qwen3.8 27B Uncensored Heretic v3
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.1 GB
GE
G.E.M-Strike
Gemma · UltimateIntent
Params30.7B
Context256K
Q4_K_M18.7 GB
GP
OpenAI Gpt Oss 20B Claude 4.5 Opus Heretic Uncensored
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
AR
Artemis 31B v1.2 Abliterix v2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma The Writer N Restless Quill 10B
Gemma · DavidAU
Params10B
Context8K
Q4_K_M6.1 GB