Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.7 GB
QW
Qwen2.5 14B Instruct
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwopus3.6 27B v2
Qwopus · michaelw9999
Params27.3B
Context256K
Smallest16.1 GB
QW
Qwopus3.6 27B Coder
Qwopus · michaelw9999
Params27.3B
Context256K
Smallest16.2 GB
QW
Qwen3.6 27B NVFP4 MTP
Qwen · michaelw9999
Params27.3B
Context256K
Smallest16.2 GB
TE
Ternary Bonsai 2 27B Uncensored Heretic
Ternary · OS-Software
Params27B
Context256K
Smallest5.9 GB
QW
Qwopus3.6 27B Coder Compat MTP
Qwopus · Jackrong
Params27B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Uncensored
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
QW
Qwen Qwen3.6 27B
Qwen · batiai
Params27B
Context256K
Q4_K_M16.5 GB
WA
Wan2.2 I2V A14B
Wan · bullerwins
Params14.3B
Context—
Q4_K_M9.7 GB
QW
Qwen Image Edit 2509
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
MI
Voxtral Small 24B
Mistral · handy-computer
Params24.3B
Context—
Q4_K_M14.3 GB
ME
Mellum2 12B A2.5B Instruct
Mellum · JetBrains
Params12.1B
Context128K
Smallest12.9 GB
KR
KREA 2 GGUFs
Krea · realrebelai
Params12.9B
Context—
Q4_K_M7.2 GB
LT
LTX 2.5
Ltx · unsloth
Params21B
Context—
Q4_K_M13.6 GB
FL
FLUX.1 schnell
Flux · city96
Params11.9B
Context—
Smallest4.0 GB
GR
Grug 12B
Grug · bartowski
Params11.9B
Context256K
Q4_K_M7.7 GB
WA
Wan2.1 14B VACE
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
GR
grug 27b mtp
Grug · ProCreations
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen Image
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GE
Google_Gemma 4 12B It
Gemma · lmstudio-community
Params11.9B
Context256K
Q4_K_M7.4 GB
MU
Muse Glimmer 30B
Muse · lmstudio-community
Params28B
Context128K
Q4_K_M16.8 GB
GE
Google_Gemma 4 26B A4B It Qat Q4_0 Unquantized
Gemma · lmstudio-community
Params25.2B
Context256K
Smallest14.4 GB
LT
LTX 2.3 uncensored v1.4 FP8
Ltx · ChrisColeTech
Params21B
Context128K
Q4_K_M7.3 GB
QW
Qwen3 32B Awq Compatible Instruct
Qwen · Qwen
Params32.8B
Context40K
Q4_K_M19.8 GB
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · yuxinlu1
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
gemma 4 31B it qat q4 0
Gemma · google
Params30.7B
Context256K
Smallest17.7 GB
FL
FLUX.1 Fill dev
Flux · YarvixPA
Params11.9B
Context—
Smallest5.2 GB
QW
Qwen3.8 27B Jumbo Fusion IQ 747 900 Turbo Brilliance 50X Reasoning Instruct NEO MAX MTP
Qwen · DavidAU
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 30B A3B
Qwen · Qwen
Params30.5B
Context40K
Q4_K_M18.6 GB