Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen3 30B A3B Instruct 2507
Qwen · second-state
Params30.5B
Context256K
Q4_K_M18.6 GB
WA
WaifuGemma4 26b a4b v1
Waifugemma · hiwaifu-research
Params25.2B
Context256K
Q4_K_M16.8 GB
ER
Eros Scribe 10.7b v3 i1
Eros · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
OR
Orca 2 13B
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
RP
RPBizkit v11 12B Thinking
Rpbizkit · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
AP
Apriel 1.6 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
CA
MN CaptainErisNebula 12B Chimera v1.1 Heretic Uncensored Abliterated
Captainerisnebula · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
SO
SorcererLM 22B iMat
Sorcererlm · Quant-Cartel
Params22.2B
Context128K
Q4_K_M13.3 GB
GE
humanizer-12b
Gemma · npario
Params11.9B
Context256K
Q4_K_M7.6 GB
QW
Qwen3.8-27B
Qwen · hammadRahman
Params27.3B
Context256K
Q4_K_M16.5 GB
GE
Gemma 4 Writers 31B V2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MP
Mpt 30b
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
GE
Gemma4
Gemma · Magnarks
Params11.9B
Context256K
Smallest7.0 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · bartowski
Params13.5B
Context256K
Q4_K_M8.2 GB
NO
Noromaid 20b v0.1.1 i1
Noromaid · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
CA
camel-ai_camel-33b-combined-data
Camel · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
MA
MN 12B Mag Mell R1 i1
Mag · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
HE
Hermes 4 14B
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
EX
Exper Alfa V1 i1
Exper · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
MI
Mistral Small 24B Base 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
DE
DeepSWE Preview
Deepswe · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
XY
Xyntetik Kvist 14B
Xyntetik · Joakimpalm-Zen
Params14.4B
Context128K
Smallest0.0 GB
TE
Ternary Bonsai 2 27B abliterated
Ternary · Override-6
Params27B
Context256K
Smallest5.9 GB
NE
Apriel Nemotron 15b Thinker
Nemotron · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
GE
Gemma 4 26B A4B It Qat Q4_0 Uncensored Heretic v2
Gemma · OS-Software
Params25.2B
Context256K
Smallest14.2 GB
SK
Skywork SWE 32B
Skywork · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
TE
Bonsai JEV
Ternary · dakebakery
Params26.9B
Context—
Smallest0.2 GB
RI
Rivermind 12B v1
Rivermind · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Pixtral 12B Ollama
Mistral · EnlistedGhost
Params12.2B
Context1000K
Q4_K_M7.5 GB