Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
MU
Muse Glimmer 30B Uncensored Heretic
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
DE
deepseek coder v2 lite instruct
DeepSeek · mad-lab-ai
Params15.7B
Context160K
Q4_K_M10.4 GB
AU
Aurora Code 1
Aurora · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QU
QuasiStarSynth 12B Noslop Absolute Heresy
Quasistarsynth · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ES
MN 12B Estrella v1 i1
Estrella · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
qwen3 coder 30b a3b
Qwen · AlexAtomic
Params30.5B
Context256K
Q4_K_M18.6 GB
RI
Rivermind Lux 12B v1
Rivermind · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
BA
bagel
Bagel · calcuis
Params14.6B
Context—
Q4_K_M8.9 GB
OP
s4sch_open-hermes-2.5-neural-chat-3.1-frankenmerge-11b
Open · TheBloke
Params11.4B
Context32K
Q4_K_M6.8 GB
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
MI
MistralAI Magistral Small 2507 Heretic Uncensored
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
QW
Deductive Reasoning Qwen 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
MA
tiger-lab_mammoth-coder-13b
Mammoth · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GE
Huihui Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
AR
Artemis 31B v1.1 Heretic
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.8 27B
Qwen · Distillio
Params27.3B
Context256K
Q4_K_M17.8 GB
SM
Smaug Humanizer
Smaug · abacusai
Params11.9B
Context256K
Q4_K_M7.4 GB
OR
Ornstein Hermes 3.6 27b SABER
Ornstein · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
NE
Nemotron Cascade 2 30B A3B Heretic Ara Uncensored
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
SO
T3Q ko solar dpo v3.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · legraphista
Params22.2B
Context64K
Smallest4.8 GB
OR
Orca 2 13B SFT v5
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
KA
Kalypso
Kalypso · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GR
Grug 27b
Grug · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
AR
Aryabhata 2.0
Aryabhata · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GO
GonzaLomo Krea 2 v4.0 checkpoint
Gonzalomo · Quiho
Params12.8B
Context—
Smallest8.3 GB
LU
Luminaura-RP-13B
Luminaura · mradermacher
Params13B
Context128K
Q4_K_M7.9 GB
GE
Gemma 4 Giftige Blume 31B v1
Gemma · Blazed-Forge
Params30.7B
Context256K
Q4_K_M18.7 GB
MA
MN 12B Mag Mell R1
Mag · inflatebot
Params12.2B
Context1000K
Q4_K_M7.5 GB
IN
InnoSpark3.1 27B 1008
Innospark · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB