FLUX.1 Fill dev needs about 13.2 GB of memory at Q4_1 (a 11.3 GB file) with an 8K context window, so it fits on a 16 GB GPU. This repository has 6 quants, from 10.1 GB (Q4_0) to 34.1 GB.
FLUX.1 Fill dev – a 12 billion‑parameter image‑in‑painting model
FLUX.1 Fill dev is a 12 billion‑parameter rectified flow transformer that fills areas in existing images based on a text description. It is trained with guidance distillation for efficient generation. The model is open‑weight and suitable for artistic and research workflows.
Good at
- Image in‑painting from text prompts
- Efficient generation with guidance distillation
- Open‑weight research use
Limits
- Not designed for factual generation
- May amplify societal biases
- Color shifts can occur in unfilled areas
Best for
- Artists creating custom in‑painting workflows
- Researchers exploring flow‑based diffusion
- Developers building image editing tools
Who it’s for. This model is intended for developers, artists, and researchers who need a flexible, open‑weight in‑painting solution. It is not suitable for applications requiring factual accuracy or bias‑free outputs.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| Q4_0 | 10.1 GB | 11.8 GB | Too big | Get file → | |
| Q4_0 | 10.3 GB | 12.0 GB | Too big | Get file → | |
| Q4_1 | 11.3 GB | 13.2 GB | Too big | Get file → | |
| Q8_0 | 18.5 GB | 21.2 GB | Too big | Get file → | |
| Q8_0 | 18.6 GB | 21.4 GB | Too big | Get file → | |
| — | 34.1 GB | 38.7 GB | Too big | Get file → |
For 8 GB VRAM use the Q4_0 quant (10.09 GB file, ~11.8 GB memory at 8k context). For 12 GB VRAM the Q4_1 quant (11.31 GB file, ~13.2 GB memory) is suitable. Larger VRAM allows the Q8_0 quant (18.51 GB file, ~21.2 GB memory).
What GPU do you need for FLUX.1 Fill dev?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: no quant fits at an 8K context.
- 12 GB VRAM: the best quant that fits is Q4_0 (10.3 GB file, about 12.0 GB in use).
- 16 GB VRAM: the best quant that fits is Q4_1 (11.3 GB file, about 13.2 GB in use).
- 24 GB VRAM: the best quant that fits is Q8_0 (18.6 GB file, about 21.4 GB in use).
- 32 GB VRAM: the best quant that fits is Q8_0 (18.6 GB file, about 21.4 GB in use).
- 48 GB VRAM: the best quant that fits is the main file (34.1 GB file, about 38.7 GB in use).
Which FLUX.1 Fill dev quant should you choose?
Q4_1 (11.3 GB) is the middle option in this repository. The usual sweet spot between file size and quality, and the quant most people start with.
If memory is tight, the smallest file is Q4_0 at 10.1 GB, with the quality trade-offs that come with fewer bits. The usual sweet spot between file size and quality, and the quant most people start with.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about FLUX.1 Fill dev
How much VRAM does FLUX.1 Fill dev need?
About 13.2 GB at Q4_1 with an 8K context window. That is the 11.3 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run FLUX.1 Fill dev on an 8 GB GPU?
Not at an 8K context. The smallest file needs about 11.8 GB, so you would need a larger GPU or CPU offloading.
What is the file size of FLUX.1 Fill dev GGUF?
It depends on the quant: Q4_0 is 10.1 GB, Q4_0 is 10.3 GB, Q4_1 is 11.3 GB, Q8_0 is 18.5 GB, Q8_0 is 18.6 GB, file is 34.1 GB.
Where can I download FLUX.1 Fill dev GGUF?
The files are on Hugging Face in the gpustack/FLUX.1-Fill-dev-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does FLUX.1 Fill dev use?
Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run FLUX.1 Fill dev on 8 GB VRAM?
Yes, the Q4_0 quant uses about 11.8 GB memory at 8k context, which fits within 8 GB VRAM with some overhead.
Does the model support vision tasks beyond in‑painting?
No, FLUX.1 Fill dev is specifically designed for image in‑painting based on text prompts.
Is the model licensed for commercial use?
Generated outputs can be used for commercial purposes under the FLUX.1 [dev] Non‑Commercial License terms.