Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SD
sdmodels
Sdmodels · MWSAH
Params11.9B
Context—
Smallest6.9 GB
GGUF
GE
Gemma 4 12B OBLITERATED
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GGUF
RE
ReflectionCoder-CL-34B
Reflectioncoder · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
QW
Qwen3.8 27B
Qwen · batiai
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
MI
Mistral Nemo Instruct Heretic
Mistral · saidutta69
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
VE
Venice Uncensored
Venice · KiloXiix
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GR
granite 20b functioncalling i1
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
GGUF
NA
Nanbeige4.3 33B cybersec abliterated
Nanbeige · FRENCHFAKER
Params33.1B
Context512K
Q4_K_M20.1 GB
ReasoningTool use
MI
Voxtral Small 24B 2507
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
DE
Qwen2.5 32B
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
GP
Gpt Oss 20b Abliterated
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
QW
Qwen3.8 27B antislop
Qwen · rawmodels
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3 32B Abliterated
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
ZA
Zaire 12B v0.1
Zaire · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 4 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen3.8 27B Humanlike Chat
Qwen · Guile
Params27B
Context256K
Q4_K_M16.6 GB
Roleplay
QW
Qwen Image Edit 2511
Qwen · vantagewithai
Params20.4B
Context—
Q4_K_M13.0 GB
GGUF
NO
North Mini Code 1.0 Uncensored Heretic
North · mradermacher
Params30.5B
Context488K
Q4_K_M18.6 GB
Coding
HE
Hemmingway 1 Heretic MTP V3 Final
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
GE
Gemma4 26B A4B Uncensored HauhauCS 1M
Gemma · satgeze
Params25.2B
Context1024K
Q4_K_M16.8 GB
Vision
GE
Gemma 4 Gembrain 31B It Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayVision
GI
ai girlfriend natsume
Girlfriend · TAOTAO777
Params27B
Context256K
Q4_K_M16.8 GB
GGUF
SA
SauerkrautLM UNA SOLAR Instruct
Sauerkrautlm · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CY
Cydonia 24B v4.1
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
CH
Chronos Gold 12B 1.0 i1
Chronos · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
TI
TieFighter Holodeck Holomax Mythomax F1 V1 COMPOS 20B
Tiefighter · DavidAU
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
WI
monero_wizardlm-uncensored-supercot-storytelling-30b
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
ZO
Zorka Vieniera 12b
Zorka · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.8-27B
Qwen · Hirt556
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
SK
Skyfall 31B v4.2 Abliterix
Skyfall · mradermacher
Params31.4B
Context128K
Q4_K_M19.0 GB
GGUF

Other sizes

Keep browsing