DE

DeepSeek V4 Flash imatrix aligned

DeepSeekGGUF by jedisct1Updated 2026-05-13
Download on Hugging Face
Parameters284B
Context—
Layers—
Architecturedeepseek4_mtp_support
Smallest quant3.8 GB
Quick answer

DeepSeek V4 Flash imatrix aligned needs about 4.8 GB of memory at Q8_0 (a 3.8 GB file) with an 8K context window, so it fits on a 6 GB GPU. This repository has 2 quants, from 3.8 GB (Q8_0) to 86.7 GB.

DeepSeek V4 Flash imatrix aligned – 284B parameter LLM with 1M‑token context

DeepSeek V4 Flash imatrix aligned is a 284 billion‑parameter language model in the DeepSeek family. It supports a one‑million‑token context length and is optimized for long‑context inference with a hybrid attention architecture. The model is released under the MIT license and is available in GGUF format.

Good at

  • Long‑context instruction following
  • Tool‑calling and JSON emission
  • Code generation in common languages

Limits

  • Requires large VRAM – 4.8 GB at 8K context for Q8_0
  • Large memory footprint – 97.6 GB at 8K context for unknown quant
  • No vision or multimodal support

Best for

  • Chatbots needing extended context
  • Complex code generation tasks
  • Domain‑specific expert consolidation

Who it’s for. Developers building chat or coding assistants that need to process long documents or maintain context over many turns. The model is suitable for users with access to high‑VRAM GPUs or large‑RAM systems.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
Q8_03.8 GB 4.8 GB
Fits Get file →
—86.7 GB 97.6 GB
Too big Get file →

For 8 GB VRAM, use the Q8_0 quant file (3.81 GB). If you have 16 GB or more, the unknown quant (86.72 GB) can be used, which requires about 97.6 GB of memory at 8K context. The estimates are approximate.

What GPU do you need for DeepSeek V4 Flash imatrix aligned?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: no quant fits at an 8K context.
  • 6 GB VRAM: the best quant that fits is Q8_0 (3.8 GB file, about 4.8 GB in use).
  • 8 GB VRAM: the best quant that fits is Q8_0 (3.8 GB file, about 4.8 GB in use).
  • 12 GB VRAM: the best quant that fits is Q8_0 (3.8 GB file, about 4.8 GB in use).
  • 16 GB VRAM: the best quant that fits is Q8_0 (3.8 GB file, about 4.8 GB in use).
  • 24 GB VRAM: the best quant that fits is Q8_0 (3.8 GB file, about 4.8 GB in use).
  • 32 GB VRAM: the best quant that fits is Q8_0 (3.8 GB file, about 4.8 GB in use).
  • 48 GB VRAM: the best quant that fits is Q8_0 (3.8 GB file, about 4.8 GB in use).

Which DeepSeek V4 Flash imatrix aligned quant should you choose?

Q8_0 (3.8 GB) is the middle option in this repository. Close to lossless. It costs roughly twice the memory of a 4-bit file, so it suits cases where you have plenty of VRAM.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architecturedeepseek4_mtp_support
Parameters284B

Source

Quantized byjedisct1
FamilyDeepSeek
Licensemit
Downloads (HF)148
Last updated2026-05-13

Frequently asked questions about DeepSeek V4 Flash imatrix aligned

How much VRAM does DeepSeek V4 Flash imatrix aligned need?

About 4.8 GB at Q8_0 with an 8K context window. That is the 3.8 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run DeepSeek V4 Flash imatrix aligned on an 8 GB GPU?

Yes, with Q8_0: the 3.8 GB file needs about 4.8 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of DeepSeek V4 Flash imatrix aligned GGUF?

It depends on the quant: Q8_0 is 3.8 GB, file is 86.7 GB.

Where can I download DeepSeek V4 Flash imatrix aligned GGUF?

The files are on Hugging Face in the jedisct1/DeepSeek-V4-Flash-imatrix-aligned repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does DeepSeek V4 Flash imatrix aligned use?

Hugging Face lists the license as mit. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run DeepSeek V4 Flash imatrix aligned on 8 GB VRAM?

Yes, using the Q8_0 quant file which is 3.81 GB and requires about 4.8 GB of VRAM at 8K context.

Does this model support vision or multimodal inputs?

No, the model is purely text‑based and does not include vision support.

What license does the model use?

The model is released under the MIT license, allowing free use and modification.

Other GGUFs of DeepSeek-V4-Flash

Similar models

Browse all →

More from jedisct1

All by jedisct1 →

More DeepSeek models

All DeepSeek →

Other large models

All large models →