Q4_K GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 16028 models have a Q4_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.
What is Q4_K?
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. The usual sweet spot between file size and quality, and the quant most people start with.
16,028 models have a Q4_K file on ggufmodels.com, and those files range from 0.0 to 621.5 GB. The most downloaded are locate anything.cpp, Qwen3.8-27B and MiniMax H3. For a longer explanation of every quant type, read GGUF quantization explained.
Frequently asked questions
What is Q4_K in GGUF?
A GGUF quantization format. Lower numbers mean smaller files and more quality loss.
Should I use Q4_K?
The usual sweet spot between file size and quality, and the quant most people start with.
How big is a Q4_K file?
Q4_K files on this site range from 0.0 to 621.5 GB, depending on the model.