Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
GE
Writer
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ST
Dolphincoder Starcoder2 15b
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
GE
Gemma 3 27b It Abliterated
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 4 Dark Orthia Untied 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
QW
Sugoi 32B Ultra
Qwen · sugoitoolkit
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Gemma 4 Ortenzya The Creative Wordsmith 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 Dark Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
BA
Bathory X 26B A4B 0.2
Bathory · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
WE
WestLake 10.7B v2
Westlake · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
Mistral Small 24B Instruct 2501
Mistral · unsloth
Params23.6B
Context32K
Q4_K_M14.3 GB
LL
Speechless Llama2 Hermes Orca Platypus WizardLM 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
IN
Ingot VII 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
GE
gemma 4 31B it uncensored
Gemma · TrevorJS
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.8 27B BaseQuant V1
Qwen · basecompute
Params27.3B
Context256K
Smallest8.4 GB
QW
Qwen3.5 27B Ultra Uncensored Heretic v2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GO
Goetia 26B A4B v1.3 Absolute Heretic ARA
Goetia · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen2.5 14B Instruct 1M
Qwen · lmstudio-community
Params14.8B
Context986K
Q4_K_M9.0 GB
SW
Swish 31B Final
Swish · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 31B Monadize v0.1
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
IN
Ingot VI 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
LL
codellama_codellama-34b-python-hf
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GE
Gemma 4 26B A4B It Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Raw Uncensored Qwen3 14b Heretic Recovered
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
MA
magnum v4 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored GGUF UltraOptimised DSpark MTP
Qwen · Solstice-AI
Params26.9B
Context256K
Q4_K_M1.1 GB
QW
Qwen3 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
MY
Mythical Destroyer L2 13B
Mythical · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.8 27B Whitehat
Qwen · QuaduxIT
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 Cyber RedTeam Surgical Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
AR
Artoma Lexicon 31B
Artoma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB