Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B OBLITERATED Mythos Class Agentic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GE
Gemma 4 Writers 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
FI
FireRed Image Edit 1.1
Firered · vantagewithai
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
KR
Wild Krea 2 turbo NSFW
Krea · ModdiAdam
Params12.8B
Context—
Smallest8.0 GB
GGUF
AR
AREX 2
Arex · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Huihui Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
SC
SCAIL Preview
Scail · vantagewithai
Params16.4B
Context—
Q4_K_M11.3 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct
Qwen · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
Coding
FL
flux2 dev
Flux · gguf-org
Params17.8B
Context—
Q4_K_M20.0 GB
GGUF
OR
Orion 26B A4B v1
Orion · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
Vision
MI
Mistral MOE 4X7B Dark MultiVerse Uncensored Enhanced32 24B
Mistral · DavidAU
Params24.2B
Context32K
Q4_K_M14.7 GB
Roleplay
GE
TangYuGe Gemma 4 12b It Qat
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Roleplay
AT
Athena v1
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
Violet Twilight v0.2
Violet · Epiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
OR
Orion Kitchoon 26B A4B
Orion · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
GE
gemma 4 26B A4B it
Gemma · AtomicChat
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
AI
Airoboros L2 13B 2.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
ThinkingCap Gemma 4 26B A4B It
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
KR
Lusty Krea 2 NSFW
Krea · ModdiAdam
Params12.8B
Context—
Q4_K_M8.3 GB
GGUF
DE
DeepSeek-V2-Lite-Chat
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
WA
NSFW Wan 14b
Wan · NSFW-API
Params14.3B
Context—
Smallest9.7 GB
GGUF
LL
Llm Jp 4.1 33b Thinking
Llm · llm-jp
Params33.2B
Context64K
Q4_K_M20.4 GB
Reasoning
PR
Prompt Refine
Prompt · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
LL
Llama 2 13B chat
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MO
Moody Krea 2 Mix V4
Moody · Henrysk
Params12.8B
Context—
Smallest2.5 GB
GGUF
QW
Qwen3.8 27B Uncensored FP8
Qwen · theresa00l
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
NE
NVIDIA-Nemotron-3-Nano-30B-A3B
Nemotron · ggml-org
Params31.6B
Context1024K
Q4_K_M22.4 GB
GGUF
SA
Sabi Noema
Sabi · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwopus3.6 27B v1 preview
Qwen · Jackrong
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
NO
North Mini Code 1.0
North · bartowski
Params30.5B
Context488K
Q4_K_M18.7 GB
Coding

Other sizes

Keep browsing