Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.7 GB
Vision
QW
Qwen2.5 14B Instruct
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwopus3.6 27B v2
Qwopus · michaelw9999
Params27.3B
Context256K
Smallest16.1 GB
GGUF
QW
Qwopus3.6 27B Coder
Qwopus · michaelw9999
Params27.3B
Context256K
Smallest16.2 GB
GGUF
QW
Qwen3.6 27B NVFP4 MTP
Qwen · michaelw9999
Params27.3B
Context256K
Smallest16.2 GB
GGUF
TE
Ternary Bonsai 2 27B Uncensored Heretic
Ternary · OS-Software
Params27B
Context256K
Smallest5.9 GB
Vision
QW
Qwopus3.6 27B Coder Compat MTP
Qwopus · Jackrong
Params27B
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
QW
Qwen3.8 27B Uncensored
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
ReasoningTool useVision
QW
Qwen Qwen3.6 27B
Qwen · batiai
Params27B
Context256K
Q4_K_M16.5 GB
Vision
WA
Wan2.2 I2V A14B
Wan · bullerwins
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
QW
Qwen Image Edit 2509
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
MI
Voxtral Small 24B
Mistral · handy-computer
Params24.3B
Context—
Q4_K_M14.3 GB
GGUF
ME
Mellum2 12B A2.5B Instruct
Mellum · JetBrains
Params12.1B
Context128K
Smallest12.9 GB
GGUF
KR
KREA 2 GGUFs
Krea · realrebelai
Params12.9B
Context—
Q4_K_M7.2 GB
GGUF
LT
LTX 2.5
Ltx · unsloth
Params21B
Context—
Q4_K_M13.6 GB
GGUF
FL
FLUX.1 schnell
Flux · city96
Params11.9B
Context—
Smallest4.0 GB
GGUF
GR
Grug 12B
Grug · bartowski
Params11.9B
Context256K
Q4_K_M7.7 GB
CodingReasoningVision
WA
Wan2.1 14B VACE
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
GGUF
GR
grug 27b mtp
Grug · ProCreations
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen Image
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
GE
Google_Gemma 4 12B It
Gemma · lmstudio-community
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
MU
Muse Glimmer 30B
Muse · lmstudio-community
Params28B
Context128K
Q4_K_M16.8 GB
Vision
GE
Google_Gemma 4 26B A4B It Qat Q4_0 Unquantized
Gemma · lmstudio-community
Params25.2B
Context256K
Smallest14.4 GB
Vision
LT
LTX 2.3 uncensored v1.4 FP8
Ltx · ChrisColeTech
Params21B
Context128K
Q4_K_M7.3 GB
GGUF
QW
Qwen3 32B Awq Compatible Instruct
Qwen · Qwen
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · yuxinlu1
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoning
GE
gemma 4 31B it qat q4 0
Gemma · google
Params30.7B
Context256K
Smallest17.7 GB
Vision
FL
FLUX.1 Fill dev
Flux · YarvixPA
Params11.9B
Context—
Smallest5.2 GB
GGUF
QW
Qwen3.8 27B Jumbo Fusion IQ 747 900 Turbo Brilliance 50X Reasoning Instruct NEO MAX MTP
Qwen · DavidAU
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningRoleplay
QW
Qwen3 30B A3B
Qwen · Qwen
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF

Other sizes

Keep browsing