Q4_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 37333 models have a Q4_1 file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
GE
Gemma-4-12B-It
Gemma · unsloth
Params11.9B
Context256K
Q4_K_M7.1 GB
Vision
QW
Qwen3.5-9B
Qwen · unsloth
Params8.95B
Context256K
Q4_K_M5.7 GB
Vision
QW
Qwen3.5-4B
Qwen · unsloth
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
IM
Z Image Turbo
Image · unsloth
Params6.15B
Context—
Q4_K_M3.9 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B
Qwen · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
CodingTool useVision
CY
Cyber Ornith 1.5 9B OBLITERATED
Cyber · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
WA
Wan2.2 I2V A14B
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
QW
Qwen Image Edit 2511
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
GP
Gpt-Oss-20B
gpt-oss · unsloth
Params20.9B
Context128K
Q4_K_M11.6 GB
GGUF
QW
Swift Qwen3.8 27b
Qwen · ukisai
Params27.3B
Context256K
Q4_K_M18.0 GB
ReasoningVision
GE
Gemma-4-E4B-It
Gemma · unsloth
Params7.5B
Context128K
Q4_K_M5.0 GB
Vision
QW
Qwen3-4B
Qwen · unsloth
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
GE
Gemma-4-E2B-It
Gemma · unsloth
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Ternary Bonsai 27B
Qwen · prism-ml
Params3.6B
Context4K
Smallest1.9 GB
Vision
QW
Qwen3-4B-Instruct-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
WA
Wan2.2 TI2V 5B
Wan · QuantStack
Params5B
Context—
Q4_K_M3.4 GB
GGUF
QW
Qwen3.5-2B
Qwen · unsloth
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
FL
FLUX.2 klein 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.6 GB
GGUF
QW
Qwen3-Vl-4B-Instruct
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
Vision
LT
LTX 2.3
Ltx · unsloth
Params21B
Context—
Q4_K_M14.2 GB
GGUF
FL
FLUX.2 klein 9B
Flux · unsloth
Params9.08B
Context—
Q4_K_M5.7 GB
GGUF
OR
Ornith-1.0-9B
Ornith · unsloth
Params8.95B
Context256K
Q4_K_M5.7 GB
Vision
QW
Qwen3-30B-A3B-Instruct-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
BI
BigBang v1
Bigbang · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
WA
Wan2.2 TI2V 5B
Wan · unsloth
Params5B
Context—
Q4_K_M3.4 GB
GGUF
QW
Qwen3.6-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen Image 2512
Qwen · unsloth
Params20.4B
Context—
Q4_K_M13.3 GB
GGUF
TH
Thomson 1.0 Small
Thomson · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision

What is Q4_1?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. The usual sweet spot between file size and quality, and the quant most people start with.

37,333 models have a Q4_1 file on ggufmodels.com, and those files range from 0.0 to 983.6 GB. The most downloaded are Qwen3.8-27B, Gemma-4-12B-It and Qwen3.5-9B. For a longer explanation of every quant type, read GGUF quantization explained.

Frequently asked questions

What is Q4_1 in GGUF?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss.

Should I use Q4_1?

The usual sweet spot between file size and quality, and the quant most people start with.

How big is a Q4_1 file?

Q4_1 files on this site range from 0.0 to 983.6 GB, depending on the model.

Other quants

Keep browsing