Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
EC
Eclipsed Phoenix 26B A4B
Eclipsed · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ST
starcoder2-15b
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M10.2 GB
GE
Gemma 4 26B A4B Heretic Stable
Gemma · prithivMLmods
Params25.2B
Context256K
Q4_K_M16.8 GB
ME
Mellum2.1-12B-A2.5B-Thinking
Mellum · wepiqx
Params12.1B
Context128K
Smallest7.0 GB
DE
DeepSeek MOE 4X8B R1 Distill Llama 3.1 Deep Thinker Uncensored 24B
DeepSeek · DavidAU
Params24.9B
Context128K
Q4_K_M15.2 GB
GE
GeM2 Llamion 14B LongChat
Gem · RichardErkhov
Params14.5B
Context195K
Q4_K_M8.8 GB
MA
tiger-lab_mammoth-coder-34b
Mammoth · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
LA
30B Lazarus i1
Lazarus · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
QW
qwen3.8 27b 1C
Qwen · sweetand
Params27.3B
Context256K
Smallest10.9 GB
QW
Qwen3 30B A3B Thinking 2507 Art
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
MO
Moistral-11B-v5b
Moistral · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
QW
Huihui Qwen3 Omni 30B A3B Thinking Abliterated
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
KI
Kimiko v2 13B
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3 14B Ft Limo
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3 30B A3B Instruct 2507 Heretic
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen2.5 32B Instruct
Qwen · EasierAI
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Gemma 4 31b It Heretic Ara
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.8-27B
Qwen · jdominick05
Params27B
Context256K
Smallest17.6 GB
GE
Gemma 4 Harmonia 31B Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
AI
jondurbin_airoboros-c34b-2.2.1
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
HU
HuatuoGPT 3 27B
Huatuogpt · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
RE
Replete LLM Mist Nemo 12b test merged 250k
Replete · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
SE
Securecoder 30b Pro v2 Merged
Securecoder · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GO
Goetia 26B A4B v1.6
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
RI
Ring Mini 2.0
Ring · inclusionAI
Params16.3B
Context32K
Q4_K_M9.9 GB
GL
Glistening Gem 31B v2.0
Glistening · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
GP
Gpt Oss 20b
gpt-oss · DavidAU
Params20.9B
Context128K
Smallest11.5 GB
GE
Gemma 4 12B StyleTune
Gemma · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
WA
WaifuGemma4 26b A4B v1
Waifugemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
KR
krea2 turbo edit
Krea · ChrisColeTech
Params12.9B
Context—
Q4_K_M7.3 GB