Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
LFM2 24B A2B REAP
Lfm · mradermacher
Params12.4B
Context125K
Q4_K_M7.5 GB
GGUF
QW
Qwen3 Omni 30B A3B Instruct
Qwen · steampunque
Params30.5B
Context64K
Smallest16.9 GB
ReasoningTool useVision
MI
Dolphin3.0 Mistral 24B
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M13.1 GB
GGUF
BE
Beepo 22B
Beepo · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
GE
Gemma 4 26B A4B StyleTune QK Heretic
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
MA
Magidonia 24B v4.2.0
Magidonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
QW
Qwen3.8 27B OBLITERATED
Qwen · mmiiguell10
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
FL
FHDR Uncensored
Flux · kpsss34
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
LL
Llama 3 16B Instruct v0.1
Llama · MaziyarPanahi
Params16.8B
Context8K
Q4_K_M10.2 GB
GGUF
GR
MN GRAND Gutenberg Lyra4 Lyra 12B DARKNESS
Grand · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SE
Securecoder 30b Pro v3 Merged
Securecoder · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
LL
CodeLlama 34b Python Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
OT
Other Test GGUFs
Other · ToastyPigeon
Params27.3B
Context256K
Smallest9.5 GB
ReasoningTool use
GP
DMind-3
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M16.0 GB
GGUF
QW
Qwen3.6 35B A3B 2Bit GSQ RCO
Qwen · chtisgit
Params31.6B
Context256K
Smallest11.6 GB
ReasoningTool useVision
TE
Ternary Bonsai 2 27B ABLITERATED UNCENSORED PHILADELPHIA CLASS
Ternary · PhillyLabs
Params26.9B
Context—
Smallest0.0 GB
GGUF
PA
Pantheon Rp 1.6 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
QW
BigBubba Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
Vision
PH
migtissera Tess v2.5 Phi 3 medium 128k 14B
Phi · RichardErkhov
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
MI
Magistral-Small-2509
Mistral · lmstudio-community
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningVision
SO
SOLAR 10.7B v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct
Qwen · second-state
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
FL
flux1 dev Q8 0
Flux · Yogotatara
Params11.9B
Context—
Smallest12.7 GB
GGUF
PS
PsyMedDestroyer i1
Psymeddestroyer · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
GP
GPT OSS Cybersecurity 20B Merged
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
DA
DaringMaid 20B
Daringmaid · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
QW
Qwen3 VL 32B Thinking
Qwen · bartowski
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningVision
AU
Augmental Unholy 13B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
openbuddy-zero-14b-v22.3-32k
Openbuddy · mradermacher
Params14B
Context32K
Q4_K_M8.4 GB
GGUF
MA
Marco Mini Instruct
Marco · mradermacher
Params17.3B
Context32K
Q4_K_M10.5 GB
Reasoning

Other sizes

Keep browsing