Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
GE
gemma 2 27b it abliterated
Gemma · QuantFactory
Params27.2B
Context8K
Q4_K_M16.6 GB
QW
Qwen3 32B Abliterated
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
NS
NSFW_13B_sft
Nsfw · mzwing
Params13.3B
Context4K
Q4_K_M8.6 GB
LF
LFM2.5 24B A2B Uncensored
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
MI
Devstral Small 2507
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
FR
Frostwind 10.7B v1
Frostwind · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GE
general models
General · Chroma111
Params11.9B
Context—
Q4_K_M6.9 GB
QW
Qwen3.6 27B uncensored abliterated i1 IQ4 XS GGUF Smaller
Qwen · lemonyins
Params27B
Context—
Smallest0.0 GB
MI
ANITA NEXT 24B Magistral 2506 VISION ITA
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Replete LLM V2.5 Qwen 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
ThinkingCap Qwen3.8 27B abliterated
Qwen · IstroSec
Params27.3B
Context256K
Q4_K_M17.0 GB
QW
Qwen2.5 Coder 14B E2E Tests
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · ScottzillaSystems
Params11.9B
Context256K
Q4_K_M7.4 GB
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GO
Godoter
Godoter · Ruler97
Params27B
Context256K
Q4_K_M16.5 GB
QW
RavenXAiLabs Chaos Agent Qwen3.8 27B Frontier Intelligence Injected OBLITERATED
Qwen · deadbydawn101
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwopus3.8 27B Flash V2 Apostate Uncensored
Qwopus · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CA
cat-v1.0-13b
Cat · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
MI
Devstral Small 2507 Vision
Mistral · EnlistedGhost
Params23.6B
Context128K
Q4_K_M14.5 GB
VE
VeriLoop E2 GSQ RCO
Veriloop · tahaalam2009
Params27B
Context256K
Smallest8.5 GB
LM
LMCocktail 10.7B v1
Lmcocktail · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
DE
gemma 4 12B IT QAT Q4 K M DeepSeek distill
DeepSeek · gwejgteheg
Params11.9B
Context256K
Smallest7.4 GB
DA
Dark Scarlett v1.0 26B A4B
Dark · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
VI
Vigogne 2 13B Instruct
Vigogne · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MY
MythoMix L2 13B
Mythomix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GL
Glistening Gem 31B v2.1
Glistening · kin2341
Params30.7B
Context256K
Q4_K_M19.6 GB
GE
medgap gemma 4 12b
Gemma · protocolsyncllc
Params11.9B
Context256K
Smallest0.5 GB
XO
XORTRON AgentRICO
Xortron · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
GL
MuXodious GLM 4.7 Flash absolute heresy APEX
GLM · Koshkasa
Params30B
Context198K
Q4_K_M19.1 GB