Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PI
PinkCherry NSFW LTX23
Pinkcherry · SexGod1979
Params21B
Context—
Smallest15.9 GB
GGUF
FL
FLUX.2 dev
Flux · city96
Params32.2B
Context—
Q4_K_M20.1 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
TO
Topxtral-4x7B-v0.1
Topxtral · RichardErkhov
Params18.5B
Context32K
Q4_K_M11.2 GB
GGUF
FL
FLUX.1 Kontext dev
Flux · QuantStack
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
QW
Qwen3 30B A3B Instruct 2507
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
XI
Xing4.0 29B A4B
Xing · Venastine-Research
Params31.2B
Context256K
Q4_K_M19.0 GB
Coding
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
QW
Qwen3.8 27B
Qwen · AtomicChat
Params27.3B
Context256K
Q4_K_M17.1 GB
ReasoningTool useVision
WA
Wan2.2 S2V 14B
Wan · QuantStack
Params16.3B
Context—
Q4_K_M13.9 GB
GGUF
QW
Qwen3Vl 30b A3B Instruct
Qwen · Qwen
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
QW
Qwen3-14B
Qwen · unsloth
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.6-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M17.1 GB
Vision
QW
Qwen3Vl 32b Instruct
Qwen · Qwen
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
WA
WAN2.2 I2V A14B DISTILL LIGHTX2V 4STEP
Wan · jayn7
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
QW
Models Qwen Qwen3 14B
Qwen · MaziyarPanahi
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
GE
Gemma 4 26B A4B It
Gemma · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
Vision
GE
Gemma 4 26B A4B
Gemma · lmstudio-community
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma 4 Ortenzya The Creative Wordsmith 31B It Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
SC
SCAIL 2
Scail · realrebelai
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
QW
Huihui Qwen3 14B Abliterated v2
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
ME
Hy Memory 30B A3B
Memory · rapatsky
Params30B
Context256K
Q4_K_M18.2 GB
GGUF
GE
Gemma-3-12B-It
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
WA
Wan2.2BasedModels
Wan · Isi99999
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
QW
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params27B
Context256K
Smallest10.0 GB
Vision
ST
StartLux-Decision-v1.1-27B-AutoThink
Startlux · startlux-models
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
QW
Models Qwen Qwen3 30B A3B
Qwen · MaziyarPanahi
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
QW
Qwen3 Omni 30B A3B Instruct
Qwen · ggml-org
Params30.5B
Context64K
Q4_K_M18.6 GB
Vision
QW
Models Qwen Qwen3 32B
Qwen · MaziyarPanahi
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF

Other sizes

Keep browsing