Q4_K GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 16028 models have a Q4_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
LO
locate anything.cpp
Locateanything · mudler
Params3.83B
Context—
Smallest4.7 GB
GGUF
QW
Qwen3.8-27B
Qwen · huihui-ai
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
MI
MiniMax H3
Minimax · unsloth
Params20B
Context—
Q4_K_M18.2 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · HauhauCS
Params30B
Context—
Smallest0.9 GB
GGUF
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · huihui-ai
Params35.5B
Context256K
Smallest13.2 GB
Vision
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · HauhauCS
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
MI
MiniMax-Music
Minimax · audio-cpp
Params4.9B
Context—
Smallest0.1 GB
GGUF
QW
Qwen Image 2.1 Turbo Uncensored
Qwen · AtomicChat
Params8.19B
Context256K
Smallest3.3 GB
CodingTool useVision
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · huihui-ai
Params10B
Context—
Smallest10.9 GB
GGUF
QW
Qwen Image 2.1 Turbo
Qwen · DogukanUrker
Params7.1B
Context—
Smallest2.4 GB
GGUF
BR
Breeze-TTS-2
Breeze · HoppouAI
Params3.01B
Context—
Smallest2.5 GB
GGUF
LI
Ling 3.0 Flash
Ling · AtomicChat
Params124B
Context128K
Q4_K_M75.3 GB
ReasoningTool use
QW
Qwen Image 2.1 Turbo
Qwen · AtomicChat
Params7.12B
Context—
Smallest2.6 GB
GGUF
AR
ark asr 3b
Ark · cstr
Params3.75B
Context—
Smallest0.0 GB
GGUF
LA
Laguna S 2.1 APEX
Laguna · Myric
Params118B
Context1024K
Smallest0.7 GB
ReasoningTool use
AU
Audio Flamingo
Audio · audio-cpp
Params—
Context—
Smallest5.5 GB
GGUF
QW
Qwen3.5-122B-A10B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params122B
Context256K
Q4_K_M74.2 GB
Vision
QW
Qwen Image 2.1
Qwen · leejet
Params7.12B
Context—
Smallest2.6 GB
GGUF
FL
Flux2 Klein 9B True V2
Flux · wikeeyang
Params9.08B
Context—
Smallest5.7 GB
GGUF
IM
Z Image Turbo
Image · leejet
Params6.15B
Context—
Smallest2.6 GB
GGUF
MI
MiniCPM V 4.7 35B A3B Uncensored
MiniCPM · AtomicChat
Params34.7B
Context256K
Smallest0.1 GB
GGUF
IN
index-echo-s2tt-gsgs1hiv
Index · audio-cpp
Params—
Context—
Smallest2.3 GB
GGUF
MO
MOSS-TTS-v1.5
Moss · christopherthompson81
Params—
Context—
Smallest9.3 GB
GGUF
MO
MOSS-TTSD-v1.0
Moss · christopherthompson81
Params—
Context—
Smallest10.2 GB
GGUF
VI
VibeVoice-ASR-Streaming-7B
Vibevoice · audio-cpp
Params7B
Context—
Smallest5.9 GB
GGUF
VI
VibeVoice ASR Streaming 1.5B
Vibevoice · christopherthompson81
Params3.1B
Context—
Smallest2.1 GB
GGUF
GE
Gemma-4-E2B-Uncensored-HauhauCS-Aggressive
Gemma · HauhauCS
Params4.65B
Context128K
Smallest3.0 GB
Vision
GE
Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
TO
Topxtral-4x7B-v0.1
Topxtral · RichardErkhov
Params18.5B
Context32K
Q4_K_M11.2 GB
GGUF

What is Q4_K?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. The usual sweet spot between file size and quality, and the quant most people start with.

16,028 models have a Q4_K file on ggufmodels.com, and those files range from 0.0 to 621.5 GB. The most downloaded are locate anything.cpp, Qwen3.8-27B and MiniMax H3. For a longer explanation of every quant type, read GGUF quantization explained.

Frequently asked questions

What is Q4_K in GGUF?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss.

Should I use Q4_K?

The usual sweet spot between file size and quality, and the quant most people start with.

How big is a Q4_K file?

Q4_K files on this site range from 0.0 to 621.5 GB, depending on the model.

Other quants

Keep browsing