Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
GE
gemma 4 12B it uncensored
Gemma · TrevorJS
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Ingot XIII 27B Q2
Qwen · dendriteholdings
Params26.9B
Context256K
Smallest5.9 GB
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.8-27B
Qwen · 6block
Params27B
Context256K
Q4_K_M17.7 GB
LL
Llm Jp 4.1 32b A3B Thinking
Llm · llm-jp
Params32B
Context64K
Q4_K_M21.5 GB
QW
Qwen_Qwen3 VL 30B A3B Instruct
Qwen · lmstudio-community
Params30.5B
Context256K
Q4_K_M18.6 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · lmstudio-community
Params15.7B
Context160K
Q4_K_M10.4 GB
GE
gemma 4 12B it heretic QAT
Gemma · SC117
Params11.9B
Context256K
Smallest6.7 GB
QW
Dongfangshuo Qwen3.8 27B NSFW Novel
Qwen · dongfangshuo
Params27B
Context256K
Q4_K_M16.5 GB
LT
LTX2.3 10Eros 1.5
Ltx · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
AR
Artemis 31B v1.2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 12b It
Gemma · ggml-org
Params11.8B
Context128K
Q4_K_M7.3 GB
BO
Boulesis v2.1 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
QW
sakura-14b-qwen3-v1.5
Qwen · SakuraLLM
Params14.8B
Context32K
Smallest8.2 GB
SM
smoothMixWan22 I2V
Smoothmixwan · Bedovyy
Params14.3B
Context—
Q4_K_M9.7 GB
QW
Qwen3.8 27B Heretic Ara
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwopus3.8 27B Flash V2 Abliterated
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GE
gemma4 12b with proj ltx 2.5
Gemma · elix3r
Params13.1B
Context—
Q4_K_M8.4 GB
GE
Gemma 4 31B StyleTune
Gemma · bartowski
Params32.1B
Context256K
Q4_K_M20.4 GB
SA
Sakura GalTransl 14B v3.8
Sakura · SakuraLLM
Params14.8B
Context128K
Q4_K_M9.0 GB
TE
Tess 4.5 27B
Tess · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
GE
gemma 4 26B A4B it Claude Opus Distill APEX
Gemma · mudler
Params25.2B
Context256K
Smallest13.0 GB
ME
MedGo i1
Medgo · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
FL
FLUX.1 Kontext dev
Flux · bullerwins
Params11.9B
Context—
Q4_K_M6.9 GB
LT
LTX 2.5 uncensored v1.1 FP8
Ltx · frtertaer
Params21B
Context—
Q4_K_M7.5 GB
QW
Ternary Bonsai 2 27B gguf dev
Qwen · prism-ml
Params27B
Context256K
Smallest7.6 GB
LL
openassistant_codellama-13b-oasst-sft-v10
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
KI
Kitchoon V2 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ST
StartLux Decision v1 27B Q8 0
Startlux · startlux-models
Params27B
Context256K
Smallest28.6 GB
QW
Qwen2.5 32B AGI
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB