Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 27B OBLITERATED Mythos Class Agentic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 Writers 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
FI
FireRed Image Edit 1.1
Firered · vantagewithai
Params20.4B
Context—
Q4_K_M13.1 GB
KR
Wild Krea 2 turbo NSFW
Krea · ModdiAdam
Params12.8B
Context—
Smallest8.0 GB
AR
AREX 2
Arex · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Huihui Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
SC
SCAIL Preview
Scail · vantagewithai
Params16.4B
Context—
Q4_K_M11.3 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
FL
flux2 dev
Flux · gguf-org
Params17.8B
Context—
Q4_K_M20.0 GB
OR
Orion 26B A4B v1
Orion · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
MI
Mistral MOE 4X7B Dark MultiVerse Uncensored Enhanced32 24B
Mistral · DavidAU
Params24.2B
Context32K
Q4_K_M14.7 GB
GE
TangYuGe Gemma 4 12b It Qat
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
AT
Athena v1
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
VI
Violet Twilight v0.2
Violet · Epiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
OR
Orion Kitchoon 26B A4B
Orion · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
gemma 4 26B A4B it
Gemma · AtomicChat
Params25.2B
Context256K
Q4_K_M16.8 GB
AI
Airoboros L2 13B 2.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GE
ThinkingCap Gemma 4 26B A4B It
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
KR
Lusty Krea 2 NSFW
Krea · ModdiAdam
Params12.8B
Context—
Q4_K_M8.3 GB
DE
DeepSeek-V2-Lite-Chat
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
WA
NSFW Wan 14b
Wan · NSFW-API
Params14.3B
Context—
Smallest9.7 GB
LL
Llm Jp 4.1 33b Thinking
Llm · llm-jp
Params33.2B
Context64K
Q4_K_M20.4 GB
PR
Prompt Refine
Prompt · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
LL
Llama 2 13B chat
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MO
Moody Krea 2 Mix V4
Moody · Henrysk
Params12.8B
Context—
Smallest2.5 GB
QW
Qwen3.8 27B Uncensored FP8
Qwen · theresa00l
Params27.3B
Context256K
Q4_K_M16.8 GB
NE
NVIDIA-Nemotron-3-Nano-30B-A3B
Nemotron · ggml-org
Params31.6B
Context1024K
Q4_K_M22.4 GB
SA
Sabi Noema
Sabi · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwopus3.6 27B v1 preview
Qwen · Jackrong
Params27B
Context256K
Q4_K_M16.5 GB
NO
North Mini Code 1.0
North · bartowski
Params30.5B
Context488K
Q4_K_M18.7 GB