Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiniMax H3
Minimax · unsloth
Params20B
Context—
Q4_K_M18.2 GB
GGUF
IM
Z Image Turbo
Image · unsloth
Params6.15B
Context—
Q4_K_M3.9 GB
GGUF
WA
Wan2.2 I2V A14B
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
OC
Occamy 1.0
Occamy · Accio-Lab
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool useVision
QW
Qwen Image Edit 2511
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
QW
Qwen3 8B Awq Compatible Instruct
Qwen · Qwen
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
qwen2.5-7b-instruct
Qwen · Qwen
Params7.6B
Context128K
Q4_K_M4.7 GB
GGUF
QW
Qwen3 4B Instruct Awq
Qwen · Qwen
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
NO
nomic-embed-text-v1.5
Nomic · nomic-ai
Params137M
Context2K
Q4_K_M0.1 GB
Embedding
WA
Wan2.2 TI2V 5B
Wan · QuantStack
Params5B
Context—
Q4_K_M3.4 GB
GGUF
FL
FLUX.2 klein 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.6 GB
GGUF
LT
LTX 2.3
Ltx · unsloth
Params21B
Context—
Q4_K_M14.2 GB
GGUF
QW
qwen2.5-1.5b-instruct
Qwen · Qwen
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
FL
FLUX.2 klein 9B
Flux · unsloth
Params9.08B
Context—
Q4_K_M5.7 GB
GGUF
WA
Wan2.2 TI2V 5B
Wan · unsloth
Params5B
Context—
Q4_K_M3.4 GB
GGUF
QW
Qwen Image 2.1 Turbo
Qwen · DogukanUrker
Params7.1B
Context—
Smallest2.4 GB
GGUF
QW
qwen2.5-0.5b-instruct
Qwen · Qwen
Params630M
Context32K
Q4_K_M0.5 GB
GGUF
WA
Wan2.2 Animate 14B
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.5 GB
GGUF
QW
Qwen Image 2512
Qwen · unsloth
Params20.4B
Context—
Q4_K_M13.3 GB
GGUF
QW
Qwen3 14B Awq Compatible Instruct
Qwen · Qwen
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct GGUF
Qwen · Qwen
Params15B
Context128K
Q4_K_M9.4 GB
Coding
JA
Jan-v3.5-4B
Jan · janhq
Params4.4B
Context256K
Q4_K_M2.7 GB
GGUF
WA
Wan2.2 T2V A14B
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
MI
MiniCPM V 4.7 35B A3B
MiniCPM · openbmb
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
GR
Granite 4.2 3b
Granite · ibm-granite
Params3.66B
Context128K
Q4_K_M2.2 GB
GGUF
GR
Granite 4.2 8b
Granite · ibm-granite
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
LI
Ling 3.0 Tiny
Ling · bloomer010
Params7.89B
Context128K
Q4_K_M4.8 GB
Coding
GR
Granite 4.2 30b
Granite · ibm-granite
Params29.3B
Context128K
Q4_K_M17.7 GB
GGUF
QW
qwen2.5-3b-instruct
Qwen · Qwen
Params3.4B
Context32K
Q4_K_M2.1 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct GGUF
Qwen · Qwen
Params1.78B
Context32K
Q4_K_M1.1 GB
Coding

What is Q5_0?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. Closer to the original model than 4-bit, for a moderate increase in size. A good pick when you have memory to spare.

21,732 models have a Q5_0 file on ggufmodels.com, and those files range from 0.0 to 706.2 GB. The most downloaded are MiniMax H3, Z Image Turbo and Wan2.2 I2V A14B. For a longer explanation of every quant type, read GGUF quantization explained.

Frequently asked questions

What is Q5_0 in GGUF?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss.

Should I use Q5_0?

Closer to the original model than 4-bit, for a moderate increase in size. A good pick when you have memory to spare.

How big is a Q5_0 file?

Q5_0 files on this site range from 0.0 to 706.2 GB, depending on the model.

Other quants

Keep browsing