Q5_K GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15099 models have a Q5_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
LO
locate anything.cpp
Locateanything · mudler
Params3.83B
Context—
Smallest4.7 GB
GGUF
QW
Qwen3.8-27B
Qwen · huihui-ai
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · HauhauCS
Params30B
Context—
Smallest0.9 GB
GGUF
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · huihui-ai
Params35.5B
Context256K
Smallest13.2 GB
Vision
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · HauhauCS
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
HI
Higgs Audio v3 Studio
Higgs · drbaph
Params4.65B
Context—
Q4_K_M4.1 GB
GGUF
QW
Qwen Image 2.1 Turbo Uncensored
Qwen · AtomicChat
Params8.19B
Context256K
Smallest3.3 GB
CodingTool useVision
QW
Qwen Image 2.1 Turbo
Qwen · AtomicChat
Params7.12B
Context—
Smallest2.6 GB
GGUF
QW
Qwen3.5-122B-A10B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params122B
Context256K
Q4_K_M74.2 GB
Vision
FL
Flux2 Klein 9B True V2
Flux · wikeeyang
Params9.08B
Context—
Smallest5.7 GB
GGUF
MI
MiniCPM V 4.7 35B A3B Uncensored
MiniCPM · AtomicChat
Params34.7B
Context256K
Smallest0.1 GB
GGUF
GE
Gemma-4-E2B-Uncensored-HauhauCS-Aggressive
Gemma · HauhauCS
Params4.65B
Context128K
Smallest3.0 GB
Vision
GE
Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
TO
Topxtral-4x7B-v0.1
Topxtral · RichardErkhov
Params18.5B
Context32K
Q4_K_M11.2 GB
GGUF
CY
Huihui CyberStrike OffSec 35B Abliterated
Cyberstrike · huihui-ai
Params35.5B
Context256K
Smallest21.7 GB
Tool useVision
SE
SeaLLMs SeaLLMs v3 7B Chat
Seallms · RichardErkhov
Params7.62B
Context—
Q4_K_M0.0 GB
GGUF
TE
test gguf sample
Test · Isotr0py
Params29M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params27B
Context256K
Smallest10.0 GB
Vision
QW
Huihui Qwen3.6 27B Abliterated
Qwen · huihui-ai
Params27.3B
Context256K
Smallest10.9 GB
Vision
FA
Jiqing tiny random falcon
Falcon · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
QW
Huihui Qwythos 9B Claude Mythos 5 1M Abliterated MTP
Qwythos · huihui-ai
Params9.2B
Context1024K
Smallest5.8 GB
ReasoningTool useVision
GR
ibm granite granite 20b code instruct
Granite · RichardErkhov
Params1.9B
Context—
Q4_K_M0.0 GB
Coding
LL
Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
AN
anthracite org magnum 12b v2
Anthracite · RichardErkhov
Params12.2B
Context—
Q4_K_M0.0 GB
GGUF
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · huihui-ai
Params35.5B
Context256K
Smallest13.2 GB
ReasoningVision
FL
flux 3 image klein
Flux · leejet
Params5.55B
Context—
Smallest2.3 GB
GGUF
GR
ibm granite granite 20b code base
Granite · RichardErkhov
Params1.9B
Context—
Q4_K_M0.0 GB
Coding
QW
Qwen Image 2.1 Turbo Uncensored
Qwen · TechnoBaptist
Params8.2B
Context256K
Smallest3.3 GB
CodingVision
LL
Dolphin 3.0 Llama 3.1 8B
Llama · dphn
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use

What is Q5_K?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. Closer to the original model than 4-bit, for a moderate increase in size. A good pick when you have memory to spare.

15,099 models have a Q5_K file on ggufmodels.com, and those files range from 0.0 to 706.2 GB. The most downloaded are locate anything.cpp, Qwen3.8-27B and Qwen3.8 27B Uncensored HauhauCS Aggressive MTP. For a longer explanation of every quant type, read GGUF quantization explained.

Frequently asked questions

What is Q5_K in GGUF?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss.

Should I use Q5_K?

Closer to the original model than 4-bit, for a moderate increase in size. A good pick when you have memory to spare.

How big is a Q5_K file?

Q5_K files on this site range from 0.0 to 706.2 GB, depending on the model.

Other quants

Keep browsing