stable diffusion 3.5 large turbo needs about 7.0 GB of memory at Q5_0 (a 5.8 GB file) with an 8K context window, so it fits on a 8 GB GPU. This repository has 6 quants, from 4.8 GB (Q4_0) to 16.3 GB (F16).
Stable Diffusion 3.5 Large Turbo in GGUF format
Stable Diffusion 3.5 Large Turbo is a 8.15 billion‑parameter image generation model. It is available as a GGUF conversion for use with llama.cpp and ComfyUI-GGUF. The model retains the original license terms and restrictions.
Good at
- High‑quality image generation
- Fast inference with quantization
- Versatile prompt handling
Limits
- No vision support
- Requires 8 k context for full performance
- License terms apply
Best for
- Generating detailed artwork
- Creating concept visuals
- Rapid prototyping of image prompts
Who it’s for. Developers and artists who need a fast, quantized version of Stable Diffusion 3.5 Large Turbo for local inference. The model is suitable for environments with limited GPU memory but sufficient RAM for the chosen quantization.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| Q4_0 | 4.8 GB | 5.8 GB | Fits | Get file → | |
| Q4_1 | 5.3 GB | 6.4 GB | Fits | Get file → | |
| Q5_0 | 5.8 GB | 7.0 GB | Fits | Get file → | |
| Q5_1 | 6.3 GB | 7.5 GB | Tight | Get file → | |
| Q8_0 | 8.8 GB | 10.3 GB | Too big | Get file → | |
| F16 | 16.3 GB | 18.7 GB | Too big | Get file → |
For 8 GB VRAM, use Q4_0 (4.77 GB, 5.8 GB memory) or Q4_1 (5.27 GB, 6.4 GB memory). For 12 GB VRAM, Q5_0 (5.77 GB, 7 GB memory) or Q5_1 (6.27 GB, 7.5 GB memory) are suitable. Higher precision quants require more memory.
What GPU do you need for stable diffusion 3.5 large turbo?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: the best quant that fits is Q4_0 (4.8 GB file, about 5.8 GB in use).
- 8 GB VRAM: the best quant that fits is Q5_1 (6.3 GB file, about 7.5 GB in use).
- 12 GB VRAM: the best quant that fits is Q8_0 (8.8 GB file, about 10.3 GB in use).
- 16 GB VRAM: the best quant that fits is Q8_0 (8.8 GB file, about 10.3 GB in use).
- 24 GB VRAM: the best quant that fits is F16 (16.3 GB file, about 18.7 GB in use).
Which stable diffusion 3.5 large turbo quant should you choose?
Q5_0 (5.8 GB) is the middle option in this repository. Closer to the original model than 4-bit, for a moderate increase in size. A good pick when you have memory to spare.
If memory is tight, the smallest file is Q4_0 at 4.8 GB, with the quality trade-offs that come with fewer bits. The usual sweet spot between file size and quality, and the quant most people start with.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Frequently asked questions about stable diffusion 3.5 large turbo
How much VRAM does stable diffusion 3.5 large turbo need?
About 7.0 GB at Q5_0 with an 8K context window. That is the 5.8 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run stable diffusion 3.5 large turbo on an 8 GB GPU?
Yes, with Q5_1: the 6.3 GB file needs about 7.5 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of stable diffusion 3.5 large turbo GGUF?
It depends on the quant: Q4_0 is 4.8 GB, Q4_1 is 5.3 GB, Q5_0 is 5.8 GB, Q5_1 is 6.3 GB, Q8_0 is 8.8 GB, F16 is 16.3 GB.
Where can I download stable diffusion 3.5 large turbo GGUF?
The files are on Hugging Face in the city96/stable-diffusion-3.5-large-turbo-gguf repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does stable diffusion 3.5 large turbo use?
Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run Stable Diffusion 3.5 Large Turbo on 8 GB VRAM?
Yes, using Q4_0 or Q4_1 quantizations. They fit within 8 GB VRAM and use approximately 5.8–6.4 GB of memory at 8 k context.
Does the GGUF version support vision tasks?
No, the model does not include vision capabilities. It is an image generation model only.
What license applies to this GGUF conversion?
The original license terms of stabilityai/stable-diffusion-3.5-large-turbo apply. No additional license is granted by the conversion.