Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 27B Q8 0
Qwen · Chungulus
Params27.3B
Context256K
Smallest29.0 GB
LL
ausboss_llama-30b-supercot
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GE
Gemma 4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MA
magnum v4 12b
Magnum · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
CA
CaptainErisNebula 12B Chimera v1.1
Captainerisnebula · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
LU
LUNA SOLARkrautLM Instruct
Luna · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Qwen3 Coder 30B A3B Instruct SOTA
Qwen · CISCai
Params30.5B
Context—
Smallest0.1 GB
MO
G4 Moonlight Dusk 26B A4B Heretic
Moonlight · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
QW
Qwen3 30B A3B Claude 4.5 Opus High Reasoning 2507 ABLITERATED UNCENSORED V2
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
SH
shisa v2.1 unphi4 14b
Shisa · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
LA
Laguna XS 2.1
Laguna · mradermacher
Params33.4B
Context256K
Q4_K_M20.3 GB
ER
ERNIE 21B A3B Claude 4.5 High OPUS Thinking
Ernie · mradermacher
Params21.8B
Context128K
Q4_K_M13.2 GB
WI
WizardCoder 15B V1.0
Wizardcoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
GE
Gemma 4 31B It Claude Opus Distill
Gemma · TeichAI
Params30.7B
Context256K
Q4_K_M18.7 GB
RI
RICO
Rico · darkc0de
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3-Vl-30B-A3B-Instruct-1M
Qwen · unsloth
Params30.5B
Context977K
Q4_K_M18.6 GB
NA
Nanbeige4.3 33B
Nanbeige · mradermacher
Params33.1B
Context512K
Q4_K_M20.1 GB
OL
Olmo-3.1-32B-Instruct
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
GL
L3 V2 S M B Grand HORROR 17B GLM4.7 Thinking UNCENSORED NEO Imatrix
GLM · DavidAU
Params16.5B
Context8K
Q4_K_M10.1 GB
GE
gemma 4 26B A4B it ara abliterated
Gemma · jenerallee78
Params25.2B
Context256K
Smallest20.6 GB
ST
starcoder2-15b
StarCoder · QuantFactory
Params16B
Context16K
Q4_K_M9.9 GB
MI
MiniMax H3
Minimax · ldov
Params20.1B
Context—
Q4_K_M18.2 GB
MI
grok oss Apollyon 24B
Mistral · c4tdr0ut
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen3 30B A3B Thinking 2507 FT
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GE
Gemma 3 12b It Abliterated
Gemma · mlabonne
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 31B It Claude Opus Distill v2 Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
CI
Cirque 12B
Cirque · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
HE
Hemmingway 1.5 Unlocked
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
HA
Harbinger 24B
Harbinger · LatitudeGames
Params23.6B
Context128K
Q4_K_M14.3 GB
NA
Nanbeige4.3 33B Base
Nanbeige · mradermacher
Params33.1B
Context128K
Q4_K_M20.1 GB