Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.6 27B ABLITERATED UNCENSORED PHILADELPHIA CLASS
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
JE
Jev Omni Q4 K M
Jev · Reza2kn
Params11.9B
Context256K
Q4_K_M7.4 GB
TR
Translategemma 27b It
Translategemma · bullerwins
Params27B
Context128K
Q4_K_M16.5 GB
QW
Josiefied Qwen3 14B Abliterated v3
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
PH
phi 4 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
MI
Pixtral
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MX
MXLewd L2 20B i1
Mxlewd · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GE
Huihui Gemma 4 31B It Abliterated v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
LL
LLaMA2 13B Psyfighter2
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
LF
LFM2.5-24B-A2B
Lfm · mudler
Params24B
Context128K
Smallest7.7 GB
QW
QiMing Holos Plus Qwen3 14B
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
UN
Hy MT2 30B A3B Uncensored Heretic
Uncensored · alphaZimuth
Params30B
Context256K
Smallest9.7 GB
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · mradermacher
Params22.2B
Context64K
Q4_K_M13.3 GB
SU
Sulphur 2 distilled Q4 K M
Sulphur · coolthor
Params21B
Context—
Q4_K_M14.2 GB
QW
Qwen3.8 27B Heretic Uncensored Q5 K M
Qwen · mlasli
Params27.3B
Context256K
Smallest19.7 GB
EV
totally-not-an-llm_everythinglm-13b-v3-16k
Everythinglm · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
LT
LTX2.3 10Eros 1.2
Ltx · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
QW
Qwen3 VL 32B Instruct Ultra Uncensored Heretic
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
HO
Holo4 27B Abliterix
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
Mistral Nemo 12B Instruct
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
EH
ehartford_wizardlm-13b-v1.0-uncensored
Ehartford · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GP
GPT OSS Cybersecurity 20B Merged Heretic
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
LL
codellama_codellama-13b-python-hf
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
WA
wan22EnhancedNSFWSVICamera nsfwV2Q6KH
Wan · tree03
Params14.3B
Context—
Smallest12.0 GB
GE
Gemory 26B A4B SOMPOA
Gemory · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8-27B
Qwen · IsValorum
Params27.3B
Context256K
Smallest12.2 GB
ME
Melody1437 12B v0.5
Melody · ReadyArt
Params11.9B
Context256K
Q4_K_M8.6 GB
NO
Noromaid 20B v0.1.1
Noromaid · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
SH
Shadow Siren 26B A4B
Shadow · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB