Q3_K GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15171 models have a Q3_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8-27B
Qwen · huihui-ai
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
MI
MiniMax H3
Minimax · unsloth
Params20B
Context—
Q4_K_M18.2 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · HauhauCS
Params30B
Context—
Smallest0.9 GB
GGUF
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · huihui-ai
Params35.5B
Context256K
Smallest13.2 GB
Vision
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · HauhauCS
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
QW
Qwen Image 2.1 Turbo Uncensored
Qwen · AtomicChat
Params8.19B
Context256K
Smallest3.3 GB
CodingTool useVision
QW
Qwen Image 2.1 Turbo
Qwen · DogukanUrker
Params7.1B
Context—
Smallest2.4 GB
GGUF
QW
Qwen Image 2.1 Turbo
Qwen · AtomicChat
Params7.12B
Context—
Smallest2.6 GB
GGUF
AR
ark asr 3b
Ark · cstr
Params3.75B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.5-122B-A10B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params122B
Context256K
Q4_K_M74.2 GB
Vision
QW
Qwen Image 2.1
Qwen · leejet
Params7.12B
Context—
Smallest2.6 GB
GGUF
IM
Z Image Turbo
Image · leejet
Params6.15B
Context—
Smallest2.6 GB
GGUF
GE
Gemma-4-E2B-Uncensored-HauhauCS-Aggressive
Gemma · HauhauCS
Params4.65B
Context128K
Smallest3.0 GB
Vision
GE
Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
TO
Topxtral-4x7B-v0.1
Topxtral · RichardErkhov
Params18.5B
Context32K
Q4_K_M11.2 GB
GGUF
SE
SeaLLMs SeaLLMs v3 7B Chat
Seallms · RichardErkhov
Params7.62B
Context—
Q4_K_M0.0 GB
GGUF
TE
test gguf sample
Test · Isotr0py
Params29M
Context—
Smallest0.0 GB
GGUF
BG
bge m3
BGE · gpustack
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
QW
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params27B
Context256K
Smallest10.0 GB
Vision
QW
Huihui Qwen3.6 27B Abliterated
Qwen · huihui-ai
Params27.3B
Context256K
Smallest10.9 GB
Vision
FA
Jiqing tiny random falcon
Falcon · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
GR
ibm granite granite 20b code instruct
Granite · RichardErkhov
Params1.9B
Context—
Q4_K_M0.0 GB
Coding
LL
Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
AN
anthracite org magnum 12b v2
Anthracite · RichardErkhov
Params12.2B
Context—
Q4_K_M0.0 GB
GGUF
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · huihui-ai
Params35.5B
Context256K
Smallest13.2 GB
ReasoningVision
FL
flux 3 image klein
Flux · leejet
Params5.55B
Context—
Smallest2.3 GB
GGUF
GR
ibm granite granite 20b code base
Granite · RichardErkhov
Params1.9B
Context—
Q4_K_M0.0 GB
Coding
QW
Qwen Image 2.1 Turbo Uncensored
Qwen · TechnoBaptist
Params8.2B
Context256K
Smallest3.3 GB
CodingVision
LL
Dolphin 3.0 Llama 3.1 8B
Llama · dphn
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use

What is Q3_K?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. A reasonable choice when a 4-bit file will not fit, mostly on larger models. Quality loss is noticeable but often acceptable.

15,171 models have a Q3_K file on ggufmodels.com, and those files range from 0.0 to 489.1 GB. The most downloaded are Qwen3.8-27B, MiniMax H3 and Qwen3.8 27B Uncensored HauhauCS Aggressive MTP. For a longer explanation of every quant type, read GGUF quantization explained.

Frequently asked questions

What is Q3_K in GGUF?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss.

Should I use Q3_K?

A reasonable choice when a 4-bit file will not fit, mostly on larger models. Quality loss is noticeable but often acceptable.

How big is a Q3_K file?

Q3_K files on this site range from 0.0 to 489.1 GB, depending on the model.

Other quants

Keep browsing