Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Writer
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
ST
Dolphincoder Starcoder2 15b
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
CodingTool use
GE
Gemma 3 27b It Abliterated
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 4 Dark Orthia Untied 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
ReasoningTool use
QW
Sugoi 32B Ultra
Qwen · sugoitoolkit
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
GE
Gemma 4 Ortenzya The Creative Wordsmith 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
GE
Gemma 4 Dark Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
ReasoningTool use
BA
Bathory X 26B A4B 0.2
Bathory · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GGUF
WE
WestLake 10.7B v2
Westlake · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
MI
Mistral Small 24B Instruct 2501
Mistral · unsloth
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LL
Speechless Llama2 Hermes Orca Platypus WizardLM 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
IN
Ingot VII 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
ReasoningTool use
GE
gemma 4 31B it uncensored
Gemma · TrevorJS
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen3.8 27B BaseQuant V1
Qwen · basecompute
Params27.3B
Context256K
Smallest8.4 GB
ReasoningTool use
QW
Qwen3.5 27B Ultra Uncensored Heretic v2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
GO
Goetia 26B A4B v1.3 Absolute Heretic ARA
Goetia · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
QW
Qwen2.5 14B Instruct 1M
Qwen · lmstudio-community
Params14.8B
Context986K
Q4_K_M9.0 GB
GGUF
SW
Swish 31B Final
Swish · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma 4 31B Monadize v0.1
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
IN
Ingot VI 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
ReasoningTool use
LL
codellama_codellama-34b-python-hf
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
GE
Gemma 4 26B A4B It Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Coding
QW
Raw Uncensored Qwen3 14b Heretic Recovered
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
MA
magnum v4 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored GGUF UltraOptimised DSpark MTP
Qwen · Solstice-AI
Params26.9B
Context256K
Q4_K_M1.1 GB
ReasoningVision
QW
Qwen3 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
GGUF
MY
Mythical Destroyer L2 13B
Mythical · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.8 27B Whitehat
Qwen · QuaduxIT
Params27.3B
Context256K
Q4_K_M16.8 GB
Tool useVision
QW
Qwen3.8 Cyber RedTeam Surgical Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
AR
Artoma Lexicon 31B
Artoma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay

Other sizes

Keep browsing