Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
LF
LFM2 24B A2B REAP
Lfm · mradermacher
Params12.4B
Context125K
Q4_K_M7.5 GB
QW
Qwen3 Omni 30B A3B Instruct
Qwen · steampunque
Params30.5B
Context64K
Smallest16.9 GB
MI
Dolphin3.0 Mistral 24B
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M13.1 GB
BE
Beepo 22B
Beepo · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GE
Gemma 4 26B A4B StyleTune QK Heretic
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
MA
Magidonia 24B v4.2.0
Magidonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.8 27B OBLITERATED
Qwen · mmiiguell10
Params27.3B
Context256K
Q4_K_M16.8 GB
FL
FHDR Uncensored
Flux · kpsss34
Params11.9B
Context—
Q4_K_M6.9 GB
LL
Llama 3 16B Instruct v0.1
Llama · MaziyarPanahi
Params16.8B
Context8K
Q4_K_M10.2 GB
GR
MN GRAND Gutenberg Lyra4 Lyra 12B DARKNESS
Grand · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
SE
Securecoder 30b Pro v3 Merged
Securecoder · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
LL
CodeLlama 34b Python Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
OT
Other Test GGUFs
Other · ToastyPigeon
Params27.3B
Context256K
Smallest9.5 GB
GP
DMind-3
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M16.0 GB
QW
Qwen3.6 35B A3B 2Bit GSQ RCO
Qwen · chtisgit
Params31.6B
Context256K
Smallest11.6 GB
TE
Ternary Bonsai 2 27B ABLITERATED UNCENSORED PHILADELPHIA CLASS
Ternary · PhillyLabs
Params26.9B
Context—
Smallest0.0 GB
PA
Pantheon Rp 1.6 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
BigBubba Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
PH
migtissera Tess v2.5 Phi 3 medium 128k 14B
Phi · RichardErkhov
Params14B
Context128K
Q4_K_M8.6 GB
MI
Magistral-Small-2509
Mistral · lmstudio-community
Params23.6B
Context128K
Q4_K_M14.3 GB
SO
SOLAR 10.7B v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · second-state
Params30.5B
Context256K
Q4_K_M18.6 GB
FL
flux1 dev Q8 0
Flux · Yogotatara
Params11.9B
Context—
Smallest12.7 GB
PS
PsyMedDestroyer i1
Psymeddestroyer · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GP
GPT OSS Cybersecurity 20B Merged
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
DA
DaringMaid 20B
Daringmaid · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
QW
Qwen3 VL 32B Thinking
Qwen · bartowski
Params32.8B
Context256K
Q4_K_M19.8 GB
AU
Augmental Unholy 13B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
OP
openbuddy-zero-14b-v22.3-32k
Openbuddy · mradermacher
Params14B
Context32K
Q4_K_M8.4 GB
MA
Marco Mini Instruct
Marco · mradermacher
Params17.3B
Context32K
Q4_K_M10.5 GB