Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
TO
tokyotech llm Swallow 13b instruct hf
Tokyotech · RichardErkhov
Params13.1B
Context4K
Q4_K_M7.9 GB
CH
austism_chronos-wizardlm-uc-scot-st-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
QW
qwen3.5 35b a3b compacted
Qwen · cahlen
Params23.5B
Context256K
Q4_K_M14.4 GB
QI
QiMing CognitiveForge 14B
Qiming · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
PocketWeights Qwen2.5 14B Coder Creative
Qwen · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
UN
Underdog Ternary 1.1
Underdog · ConwayResearch
Params27B
Context256K
Smallest7.2 GB
FO
Foresight 32B
Foresight · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Huihui Qwen3 Coder 30B A3B Instruct Abliterated
Qwen · AI-conn
Params30.5B
Context256K
Q4_K_M18.6 GB
MI
allura org Mistral Small Sisyphus 24b 2503
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
HA
Hamanasu 15B Adventure i1
Hamanasu · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GE
Gemma 4 26B A4B It Claude Opus Distill
Gemma · TeichAI
Params25.2B
Context256K
Q4_K_M16.8 GB
GR
Granite 20b Code Base 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
MI
Devstral Small 2505 Abliterated
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MA
Magidonia 24B v4.3 Heretic v3
Magidonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Candid 3.5
Qwen · Verdugie
Params26.9B
Context256K
Q4_K_M16.9 GB
GE
Gemma 3 12b It Vl GLM 4.7 Flash Polaris Thinking Heretic Uncensored
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GL
GLM 4.7 Flash heretic
GLM · ThalisAI
Params30B
Context198K
Q4_K_M18.1 GB
QW
Qwen3.8 27B OBLITERATED 12GB
Qwen · cognitivers
Params27.3B
Context—
Smallest0.0 GB
LT
joyai echo ltx25 echoVid
Ltx · joeygambino
Params21B
Context—
Q4_K_M14.2 GB
LL
Llama 3.2 8X3B GATED MOE NEO Reasoning Dark Champion uncensored 18.4B IMAT
Llama · DavidAU
Params18.4B
Context128K
Q4_K_M11.3 GB
GE
Gemma 4 Gembrain X 31B
Gemma · Nimbz
Params30.7B
Context256K
Q4_K_M18.7 GB
GR
Granite 20b Code Base
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
MI
Magistral Small 2507 Rebased Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
AU
Austral 24B Winton
Austral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
MiniMax H3 Hybrid b25 49
Minimax · hoidhxd
Params20.1B
Context—
Smallest11.4 GB
LL
Llama 2 13b Hf
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GP
Gpt-Oss-Safeguard-20B
gpt-oss · unsloth
Params20.9B
Context128K
Q4_K_M11.6 GB
GE
Gemma 4 Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
QW
Swift 1.5 Qwen3.8 27b Heretic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
AR
Artemis 31B v1.2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB