Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
WA
WAN2.2 14B Rapid AllInOne GGUF NSFW v10
Wan · desirel
Params16.4B
Context—
Q4_K_M10.8 GB
GGUF
GE
gemma 4 26B A4B it qat heretic
Gemma · SC117
Params25.2B
Context256K
Smallest14.2 GB
CodingVision
GE
Gemma 3 12b It
Gemma · lmstudio-community
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GL
GLM 4.7 Flash
GLM · ggml-org
Params30B
Context198K
Smallest18.2 GB
GGUF
WA
Wan2.1 FLF2V 14B 720P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB
GGUF
QW
Qwen Image
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
QW
QwQ 32B
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
ME
G4 MeroMero 31B
Meromero · zerofata
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
MA
Magidonia 24B v4.3
Magidonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
QW
Huihui Qwable 3.6 27b abliterated MTP
Qwable · huihui-ai
Params27.3B
Context256K
Q4_K_M20.5 GB
Vision
LT
LTX Video
Ltx · Isi99999
Params21B
Context—
Q4_K_M14.3 GB
GGUF
GL
GLM 4.7 Flash
GLM · bartowski
Params30B
Context198K
Q4_K_M18.5 GB
GGUF
GE
gemma 4 12B it
Gemma · AtomicChat
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
QW
Huihui Qwen3 30B A3B Instruct 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen3 14B Abliterated
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.5-27B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Huihui Qwable 3.6 27b abliterated
Qwable · huihui-ai
Params27B
Context256K
Q4_K_M19.7 GB
Vision
QW
Models Qwen Qwen3 30B A3B Instruct 2507
Qwen · MaziyarPanahi
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
TE
Ternary Bonsai 2 27B Abliterated PTQ1 0
Ternary · BoldingBuilds
Params26.9B
Context256K
Smallest5.9 GB
ReasoningTool use
WA
Wan2.2 VACE Fun A14B
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
GGUF
QW
Qwen3.6 27B A3B Coder
Qwen · ManniX-ITA
Params26.2B
Context256K
Q4_K_M14.7 GB
CodingVision
QW
Qwen3 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
MI
Dolphin3.0 Mistral 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingTool use
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
WA
Wan2.1 I2V 14B 720P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB
GGUF
QW
Qwen Image Layered
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
QW
Qwen_Qwen3 30B A3B Instruct 2507
Qwen · lmstudio-community
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Huihui Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
LO
LongCat Video Avatar 1.5 GGUF ComfyUI
Longcat · vantagewithai
Params15.9B
Context—
Q4_K_M12.1 GB
GGUF
MI
mistralai_Ministral 3 14B Reasoning 2512
Mistral · lmstudio-community
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningVision

Other sizes

Keep browsing