Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
PI
PinkCherry NSFW LTX23
Pinkcherry · SexGod1979
Params21B
Context—
Smallest15.9 GB
FL
FLUX.2 dev
Flux · city96
Params32.2B
Context—
Q4_K_M20.1 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
TO
Topxtral-4x7B-v0.1
Topxtral · RichardErkhov
Params18.5B
Context32K
Q4_K_M11.2 GB
FL
FLUX.1 Kontext dev
Flux · QuantStack
Params11.9B
Context—
Q4_K_M6.9 GB
QW
Qwen3 30B A3B Instruct 2507
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
XI
Xing4.0 29B A4B
Xing · Venastine-Research
Params31.2B
Context256K
Q4_K_M19.0 GB
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.8 27B
Qwen · AtomicChat
Params27.3B
Context256K
Q4_K_M17.1 GB
WA
Wan2.2 S2V 14B
Wan · QuantStack
Params16.3B
Context—
Q4_K_M13.9 GB
QW
Qwen3Vl 30b A3B Instruct
Qwen · Qwen
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3-14B
Qwen · unsloth
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3.6-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M17.1 GB
QW
Qwen3Vl 32b Instruct
Qwen · Qwen
Params32.8B
Context256K
Q4_K_M19.8 GB
WA
WAN2.2 I2V A14B DISTILL LIGHTX2V 4STEP
Wan · jayn7
Params14.3B
Context—
Q4_K_M9.7 GB
QW
Models Qwen Qwen3 14B
Qwen · MaziyarPanahi
Params14.8B
Context40K
Q4_K_M9.0 GB
GE
Gemma 4 26B A4B It
Gemma · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
GE
Gemma 4 26B A4B
Gemma · lmstudio-community
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 Ortenzya The Creative Wordsmith 31B It Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
SC
SCAIL 2
Scail · realrebelai
Params16.4B
Context—
Q4_K_M10.9 GB
QW
Huihui Qwen3 14B Abliterated v2
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ME
Hy Memory 30B A3B
Memory · rapatsky
Params30B
Context256K
Q4_K_M18.2 GB
GE
Gemma-3-12B-It
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
WA
Wan2.2BasedModels
Wan · Isi99999
Params14.3B
Context—
Q4_K_M9.7 GB
QW
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params27B
Context256K
Smallest10.0 GB
ST
StartLux-Decision-v1.1-27B-AutoThink
Startlux · startlux-models
Params27B
Context256K
Q4_K_M16.5 GB
QW
Models Qwen Qwen3 30B A3B
Qwen · MaziyarPanahi
Params30.5B
Context40K
Q4_K_M18.6 GB
QW
Qwen3 Omni 30B A3B Instruct
Qwen · ggml-org
Params30.5B
Context64K
Q4_K_M18.6 GB
QW
Models Qwen Qwen3 32B
Qwen · MaziyarPanahi
Params32.8B
Context40K
Q4_K_M19.8 GB