Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
OZ
lyrics room final refiner ozan v1
Ozan · rambrogi
Params12.2B
Context128K
Smallest13.0 GB
WI
Wicked Stuff 26B A4B v3.0 Final
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
XY
Xyntetik Kvist 14B
Xyntetik · mradermacher
Params14.4B
Context128K
Q4_K_M10.3 GB
LU
Lumimaid v0.2 12B
Lumimaid · NeverSleep
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen2.5 VL 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context125K
Q4_K_M19.9 GB
OM
Omega Arsenal 12B
Omega · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
LO
loras wan
Loras · rgomezs2010
Params14.3B
Context—
Smallest15.4 GB
AR
Artemis 31B v1.2
Artemis · Abiray
Params30.7B
Context256K
Q4_K_M18.7 GB
TE
Terminal RSI 27B
Terminal · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
QW
Qwen3.6 27B A3B CoderX
Qwen · ManniX-ITA
Params26.2B
Context256K
Q4_K_M16.1 GB
LU
Lunar Huntress 0.1
Lunar · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Replete LLM V2.5 Qwen 14b
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
FL
FLUX.1 dev
Flux · leejet
Params11.9B
Context—
Smallest4.2 GB
GE
Gemma 4 31B StyleTune
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
Gemma 3 27b It
Gemma · ggml-org
Params27B
Context128K
Q4_K_M16.5 GB
IN
Ingot X 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
WI
Wicked Stuff 26B A4B v2.1 FINAL
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
SE
SexyGPT v3 Thinking Female
Sexygpt · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MT
Mtreelva Dune 12B
Mtreelva · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
GP
Gpt Oss 20b Heretic Ara v3
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
QW
MiniMax H3 TextEncoder 16GB abliterated
Qwen · pottokao
Params25.8B
Context256K
Smallest12.6 GB
QW
Himeros V2 27B
Qwen · Skttttt
Params27B
Context256K
Q4_K_M16.5 GB
TI
Tifa Deepsex 14b CoT
Tifa · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GR
Granite 20b Functioncalling
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
KI
Kitchoon V3.1 26B A4B
Kitchoon · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
TI
TimeCrystal l2 13B i1
Timecrystal · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
PY
Pygmalion 2 13B
Pygmalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwopus3.8 27B Flash V2 Apostate Uncensored
Qwopus · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
KO
Koa Express 31B Qat
Koa · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB