Q4_K_M GGUF models
4-bit k-quant, medium. The common default: a good balance of size and quality. 148631 models have a Q4_K_M file. Sizes run from 1M to 2450B parameters. The longest trained context is 4194304K tokens.
SU
Sulphur 2 Base
Sulphur · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
QW
Qwen3.5-397B-A17B
Qwen · unsloth
Params397B
Context256K
Q4_K_M244.1 GB
GE
Gemma 4 12B Coder Fable5 Composer2.5 v1 Uncensored Heretic
Gemma · llmfan46
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
gemma 4 E2B it uncensored
Gemma · TrevorJS
Params4.65B
Context128K
Q4_K_M3.4 GB
LL
dolphin 2.9 llama3 8b
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 0.6B Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3 0.6B Heretic Abliterated Uncensored
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
MI
Ministral-3-8B-Instruct-2512
Mistral · unsloth
Params8.49B
Context256K
Q4_K_M5.2 GB
CE
MN 12B Celeste V1.9
Celeste · nothingiisreal
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3 0.6B Heretic
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
JE
JEV 27B VL
Jev · prithivMLmods
Params27B
Context256K
Q4_K_M16.5 GB
GL
GLM 5.3 Flash Uncensored
GLM · orcarouter
Params321B
Context1024K
Q4_K_M193.0 GB
QW
Qwen3.6 35B A3B Uncensored
Qwen · xCloudinfo
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Bahushruth Qwen3.6 35B A3B Abliterated v4
Qwen · Bahushruth
Params34.7B
Context256K
Q4_K_M21.2 GB
DE
DeepSeek V4.1 Flash UNCENSORED Protium
DeepSeek · Solstice-AI
Params748B
Context1024K
Q4_K_M426.1 GB
LI
Ling-3.0-tiny
Ling · inclusionAI
Params7.9B
Context128K
Q4_K_M4.8 GB
QW
Qwen3 14B Abliterated Conservative
Qwen · richardyoung
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3 Next 80B A3B Instruct
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
NE
NVIDIA-Nemotron-3.5-Bolt-74B-A9B
Nemotron · AtomicChat
Params74B
Context256K
Q4_K_M51.7 GB
QW
Qwen3.5-2B
Qwen · unsloth
Params1.94B
Context256K
Q4_K_M1.3 GB
NE
NVIDIA Nemotron 3 Nano 4B
Nemotron · nvidia
Params3.97B
Context1024K
Q4_K_M2.8 GB
QW
Qwen_Qwen3.5 0.8B
Qwen · lmstudio-community
Params752M
Context256K
Q4_K_M0.5 GB
HO
Holo4 27B
Holo · Hcompany
Params27B
Context256K
Q4_K_M16.9 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · AtomicChat
Params32.9B
Context1024K
Q4_K_M25.0 GB
QW
Qwen2.5 VL 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context125K
Q4_K_M1.9 GB
LL
testmod koen llama2 13b dpotrain testver
Llama · RichardErkhov
Params13B
Context—
Q4_K_M0.0 GB
QW
Qwen3 8B Abliterated
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
KI
Kimi Linear 48B A3B Instruct
Kimi · bartowski
Params49.1B
Context1024K
Q4_K_M30.1 GB
QW
Qwen3 8B Hivemind Instruct Heretic Abliterated Uncensored NEO Imatrix
Qwen · DavidAU
Params7.66B
Context256K
Q4_K_M4.7 GB