Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
qwen3.8 27b abliterated 3.69bpw 12GB MTP
Qwen · soyaakinohara
Params27.3B
Context256K
Smallest12.6 GB
GGUF
QW
Qwen3 VL 32B Instruct
Qwen · bartowski
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
VI
MN Violet Lotus 12B
Violet · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
OM
Omega Arsenal 12B
Omega · ReadyArt
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
OP
OpenJev
Openjev · ggml-org
Params27B
Context256K
Q4_K_M19.4 GB
Vision
QW
Qwen3 30B A3B Abliterated Erotic
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
GE
Gemma-4-26B-A4B-It
Gemma · mudler
Params25.2B
Context256K
Smallest9.5 GB
Vision
TE
Ternary Bonsai 2 27B 262k
Ternary · CaryPalmer
Params27.3B
Context256K
Smallest6.4 GB
Tool use
GO
Goetia 26B A4B v1.7
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
LF
LFM2.5-24B-A2B
Lfm · NANI-Nithin
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
GE
Gemma 4 Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
DE
DeepSeek-V2-Lite
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
GGUF
QW
Qwen2.5 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Ingot XV 27B Q2
Qwen · dendriteholdings
Params26.9B
Context256K
Smallest5.9 GB
ReasoningTool use
ME
Melody1437 26B A4B v2.0
Melody · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
QW
Qwen3.8 27B Uncensored Chinese
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
MI
MiniMax H3 Singularity
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
GE
Gemma 4 31B It Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Coding
LL
Llama 3.2 11B Vision Instruct
Llama · leafspark
Params9.78B
Context128K
Q4_K_M6.0 GB
Vision
QW
Qwen2.5 VL 32B Instruct Unredacted MAX
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
Qwen3.8 27B Uncensored Heretic Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct Abliterated
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
GL
Huihui GLM 4.7 Flash Abliterated
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
FL
FluxDev8AnimeNsfw
Fluxdev · Zuntan
Params11.9B
Context—
Smallest6.8 GB
GGUF
IN
Ingot XII 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest5.9 GB
ReasoningTool use
QW
Qwen3.8 27B Uncensored Heretic v3
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.1 GB
Vision
GE
G.E.M-Strike
Gemma · UltimateIntent
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
GP
OpenAI Gpt Oss 20B Claude 4.5 Opus Heretic Uncensored
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Reasoning
AR
Artemis 31B v1.2 Abliterix v2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Gemma The Writer N Restless Quill 10B
Gemma · DavidAU
Params10B
Context8K
Q4_K_M6.1 GB
Roleplay

Other sizes

Keep browsing