DE

Huihui DeepSeek V4 Flash Vision Exp abliterated

DeepSeekGGUF by huihui-aiUpdated 2026-09-10
Download on Hugging Face
Parameters284B
Context—
Layers—
Architecturedeepseek4
Smallest quant135.3 GB
Quick answer

Huihui DeepSeek V4 Flash Vision Exp abliterated needs about 170.2 GB of memory at Q4_K (a 151.5 GB file) with an 8K context window, which is more than a 48 GB GPU holds. This repository has 3 quants, from 135.3 GB (Q3_K) to 156.4 GB (BF16).

DeepSeek V4 Flash Vision Exp abliterated – a multimodal LLM with reduced safety filtering

Huihui DeepSeek V4 Flash Vision Exp abliterated is a 284‑billion‑parameter model based on the DeepSeek‑V4‑Flash architecture. It includes visual modules and has been ablated to remove certain layers. The model is released under the MIT license and is available in GGUF format.

Good at

  • Multimodal text and image understanding
  • Large context handling
  • Research‑grade experimentation

Limits

  • No vision support in llama.cpp without custom code
  • Large VRAM requirement for full precision
  • Reduced safety filtering – not for production use

Best for

  • Academic research on multimodal LLMs
  • Controlled testing of vision capabilities
  • Exploring ablation effects

Who it’s for. Researchers and developers who need a multimodal DeepSeek model with reduced safety filtering for controlled experiments. The model is suitable for testing vision‑language tasks in a research setting.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
Q3_K135.3 GB 152.1 GB
Too big Get file →
Q4_K151.5 GB 170.2 GB
Too big Get file →
BF16156.4 GB 175.6 GB
Too big Get file →

For 8 GB VRAM use Q3_K (file size 135.32 GB, estimated 152.1 GB memory at 8k context). For 12 GB VRAM use Q4_K (151.54 GB, 170.2 GB memory). For 16 GB VRAM use BF16 (156.38 GB, 175.6 GB memory). Estimates are approximate.

What GPU do you need for Huihui DeepSeek V4 Flash Vision Exp abliterated?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: no quant fits at an 8K context.
  • 6 GB VRAM: no quant fits at an 8K context.
  • 8 GB VRAM: no quant fits at an 8K context.
  • 12 GB VRAM: no quant fits at an 8K context.
  • 16 GB VRAM: no quant fits at an 8K context.
  • 24 GB VRAM: no quant fits at an 8K context.
  • 32 GB VRAM: no quant fits at an 8K context.
  • 48 GB VRAM: no quant fits at an 8K context.

Which Huihui DeepSeek V4 Flash Vision Exp abliterated quant should you choose?

Q4_K (151.5 GB) is the middle option in this repository. The usual sweet spot between file size and quality, and the quant most people start with.

If memory is tight, the smallest file is Q3_K at 135.3 GB, with the quality trade-offs that come with fewer bits. A reasonable choice when a 4-bit file will not fit, mostly on larger models. Quality loss is noticeable but often acceptable.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architecturedeepseek4
Parameters284B

Source

Quantized byhuihui-ai
FamilyDeepSeek
Licensemit
Downloads (HF)33,263
Last updated2026-09-10

Frequently asked questions about Huihui DeepSeek V4 Flash Vision Exp abliterated

How much VRAM does Huihui DeepSeek V4 Flash Vision Exp abliterated need?

About 170.2 GB at Q4_K with an 8K context window. That is the 151.5 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run Huihui DeepSeek V4 Flash Vision Exp abliterated on an 8 GB GPU?

Not at an 8K context. The smallest file needs about 152.1 GB, so you would need a larger GPU or CPU offloading.

What is the file size of Huihui DeepSeek V4 Flash Vision Exp abliterated GGUF?

It depends on the quant: Q3_K is 135.3 GB, Q4_K is 151.5 GB, BF16 is 156.4 GB.

Where can I download Huihui DeepSeek V4 Flash Vision Exp abliterated GGUF?

The files are on Hugging Face in the huihui-ai/Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does Huihui DeepSeek V4 Flash Vision Exp abliterated use?

Hugging Face lists the license as mit. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 8 GB VRAM?

Use the Q3_K quantized file; it requires about 152.1 GB of VRAM at 8k context, which exceeds 8 GB, so it is not feasible.

Does this model support vision tasks in llama.cpp?

Standard llama.cpp does not include vision support; custom code is needed to handle image inputs.

Is the model safe for production use?

No. The safety filtering has been significantly reduced, and the model is intended for research and controlled environments only.

Other GGUFs of DeepSeek-V4-Flash-Vision-Exp

Similar models

Browse all →

More from huihui-ai

All by huihui-ai →

More DeepSeek models

All DeepSeek →

Other large models

All large models →