Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
GE
Gemma 4 12B It Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Orthia-31B
Gemma · Nimbz
Params32B
Context256K
Q4_K_M19.8 GB
QW
Qwen2.5 Coder 14B
Qwen · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.8 27B
Qwen · SoAIHQ
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
Devstral Small 2 24B Instruct Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
DA
G4 Dark Soul 26B A4B
Dark · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
BO
Boundary 4x7b MoE i1
Boundary · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
QW
ATX Swift 1.5 Qwen3.8 27B Uncensored IQ4 XS M
Qwen · jakeatx
Params27.3B
Context256K
Smallest0.0 GB
AI
jondurbin_airoboros-c34b-2.1
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
QW
Qwen3.8 27B GSQ RCO IQ3 S recovered
Qwen · Joakimpalm-Zen
Params26.9B
Context256K
Smallest3.2 GB
LL
code Llama 2 13B i1
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
PA
Pantheon Proto RP 1.8 30B A3B
Pantheon · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
GE
Gemma 4 26B A4B It SOMPOA Heresy
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3-14B-128K
Qwen · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Dongfangshuo Qwen3.8 27B NSFW
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
SK
Skyfall 31B v4.2 Heretic
Skyfall · mradermacher
Params31.4B
Context128K
Q4_K_M19.0 GB
DA
Dark Scarlett 27B v3.0
Dark · ReadyArt
Params27.3B
Context256K
Q4_K_M23.5 GB
QW
Qwen2.5 Coder 14B Instruct Uncensored Q4 K M
Qwen · roleplaiapp
Params14.8B
Context32K
Q4_K_M9.0 GB
EK
Ekbasis 27B
Ekbasis · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
EX
EXAONE-4.0-32B
Exaone · LGAI-EXAONE
Params32B
Context128K
Q4_K_M19.3 GB
KA
KansenSakura Eclipse RP 12b
Kansensakura · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Gemma 4 12B It Heretic_Decensored
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3 VL 32B Instruct Ultra Uncensored Heretic
Qwen · llmfan46
Params32.8B
Context256K
Q4_K_M19.8 GB
LF
LFM2.5 24B A2B Abliterated
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
OP
openthaigpt 1.0.0 beta 13B chat
Openthaigpt · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
LL
CodeUp Llama 2 13B Chat HF
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
DE
Qwen3 30B A3B Deepseek Distill Instruct 2507
DeepSeek · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.6 27B abliterated
Qwen · wangzhang
Params27B
Context256K
Q4_K_M16.5 GB
MI
MixTaoTruthful-13B-slerp
Mixtaotruthful · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
ST
Starcoder2 15b
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB