Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
BE
Bernini R GGUF ComfyUI
Bernini · vantagewithai
Params14.3B
Context—
Q4_K_M9.7 GB
DA
Dans PersonalityEngine V1.1.0 12b
Dans · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
SE
SexyGPT v3 Thinking Female
Sexygpt · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
PS
Psyonic Cetacean Ultra Quality 20b GGUF imatrix
Psyonic · DavidAU
Params20B
Context4K
Q4_K_M12.0 GB
CA
Carnice V3
Carnice · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
SM
Smaug Humanizer
Smaug · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3.8 27B Uncensored
Qwen · prakharprasad
Params27.3B
Context256K
Q4_K_M16.8 GB
PY
Python Code 13B
Python · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.6 27B Abliterated Heretic Uncensored BF16 v4
Qwen · Youssofal
Params27B
Context256K
Q4_K_M16.5 GB
GE
Gemma 4 Dark Thoughts V2 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 14B Instruct
Qwen · ThomasBaruzier
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.8 27B Heretic Uncensored Q4 K M
Qwen · mlasli
Params27.3B
Context256K
Q4_K_M17.0 GB
GR
Grug 27b
Grug · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
LF
LFM2.5 24B A2B Uncensored2
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
HU
HunyuanVideo I2V
Hunyuanvideo · city96
Params12.8B
Context—
Q4_K_M7.9 GB
LL
Colossal LLaMA 2 13b Base
Llama · mradermacher
Params13.4B
Context4K
Q4_K_M8.1 GB
D3
d3
mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ME
Mero Artemis 31B v1
Mero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 Queen 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 32B ArliAI RPMax v1.3
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
FL
flux.1dev abliterated
Flux · raidenzeke
Params11.9B
Context—
Smallest12.7 GB
QW
Qwen3.6 27B OBLITERATED
Qwen · OBLITERATUS
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen3 14B
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3.8 27B Uncensored JoyFox Aggressive
Qwen · joyfox
Params27.3B
Context256K
Q4_K_M16.5 GB
BO
Bonsai 27b 1bit CRACK
Bonsai · dealignai
Params27B
Context256K
Smallest4.7 GB
MA
Magnum 12b v2
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
mistralai_Ministral 3 14B Instruct 2512 BF16
Mistral · lmstudio-community
Params13.5B
Context256K
Q4_K_M8.2 GB
QW
Qwen3.8-27B
Qwen · IsValorum
Params27.3B
Context256K
Smallest14.2 GB
QW
Qwen3 32B
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.8 GB