Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
EC
Eclipsed Phoenix 26B A4B
Eclipsed · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
ST
starcoder2-15b
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M10.2 GB
Coding
GE
Gemma 4 26B A4B Heretic Stable
Gemma · prithivMLmods
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningVision
ME
Mellum2.1-12B-A2.5B-Thinking
Mellum · wepiqx
Params12.1B
Context128K
Smallest7.0 GB
CodingReasoning
DE
DeepSeek MOE 4X8B R1 Distill Llama 3.1 Deep Thinker Uncensored 24B
DeepSeek · DavidAU
Params24.9B
Context128K
Q4_K_M15.2 GB
ReasoningRoleplay
GE
GeM2 Llamion 14B LongChat
Gem · RichardErkhov
Params14.5B
Context195K
Q4_K_M8.8 GB
GGUF
MA
tiger-lab_mammoth-coder-34b
Mammoth · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LA
30B Lazarus i1
Lazarus · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
QW
qwen3.8 27b 1C
Qwen · sweetand
Params27.3B
Context256K
Smallest10.9 GB
Vision
QW
Qwen3 30B A3B Thinking 2507 Art
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
MO
Moistral-11B-v5b
Moistral · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
QW
Huihui Qwen3 Omni 30B A3B Thinking Abliterated
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
Reasoning
KI
Kimiko v2 13B
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3 14B Ft Limo
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen3 30B A3B Instruct 2507 Heretic
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen2.5 32B Instruct
Qwen · EasierAI
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
GE
Gemma 4 31b It Heretic Ara
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen3.8-27B
Qwen · jdominick05
Params27B
Context256K
Smallest17.6 GB
GGUF
GE
Gemma 4 Harmonia 31B Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
AI
jondurbin_airoboros-c34b-2.2.1
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
HU
HuatuoGPT 3 27B
Huatuogpt · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Reasoning
RE
Replete LLM Mist Nemo 12b test merged 250k
Replete · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SE
Securecoder 30b Pro v2 Merged
Securecoder · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
GO
Goetia 26B A4B v1.6
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
RI
Ring Mini 2.0
Ring · inclusionAI
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
GL
Glistening Gem 31B v2.0
Glistening · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
GGUF
GP
Gpt Oss 20b
gpt-oss · DavidAU
Params20.9B
Context128K
Smallest11.5 GB
CodingReasoning
GE
Gemma 4 12B StyleTune
Gemma · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
Roleplay
WA
WaifuGemma4 26b A4B v1
Waifugemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
KR
krea2 turbo edit
Krea · ChrisColeTech
Params12.9B
Context—
Q4_K_M7.3 GB
GGUF

Other sizes

Keep browsing