Qwen3 4B Text Encoder DHQ needs about 4.6 GB of memory at its main file (a 2.9 GB file) with an 8K context window, so it fits on a 6 GB GPU. This repository has 2 quants, from 2.9 GB to 2.9 GB. Longer context needs more: at 32K tokens the KV cache alone adds about 4.8 GB.
Qwen3 4B Text Encoder DHQ – a diffusion‑model‑optimized text encoder
Qwen3 4B Text Encoder DHQ is a 4.02 billion‑parameter model fine‑tuned for use as a diffusion model text encoder. It is distributed as two 2.91 GB GGUF files quantized with DHQ. The model supports prompt enhancement and text encoding for Z‑Image workflows.
Good at
- Prompt enhancement for visual generation
- Text encoding for diffusion models
- Local prompt rewriting
Limits
- No vision support
- Requires 8 k context for full performance
- License is apache‑2.0
Best for
- Local prompt‑enhancement in ComfyUI
- Replacing Z‑Image text encoder in LM Studio
- Running as a diffusion model text encoder
Who it’s for. Users who need a lightweight text encoder for diffusion models, especially those working with Z‑Image or similar pipelines. It is suitable for local, private workflows without external telemetry.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 2.9 GB | 4.6 GB | Fits | Get file → | |
| — | 2.9 GB | 4.6 GB | Fits | Get file → |
The GGUF files are 2.91 GB each and require approximately 4.6 GB of VRAM at 8 k context. If you have 8 GB VRAM, the model will run comfortably. No additional quant options are listed.
What GPU do you need for Qwen3 4B Text Encoder DHQ?
These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: the best quant that fits is the main file (2.9 GB file, about 4.6 GB in use).
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Qwen3 4B Text Encoder DHQ
How much VRAM does Qwen3 4B Text Encoder DHQ need?
About 4.6 GB at its main file with an 8K context window. That is the 2.9 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Qwen3 4B Text Encoder DHQ on an 8 GB GPU?
Yes, with the smaller files: the 2.9 GB file needs about 4.6 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of Qwen3 4B Text Encoder DHQ GGUF?
It depends on the quant: file is 2.9 GB, file is 2.9 GB.
What context length does Qwen3 4B Text Encoder DHQ support?
The GGUF header lists a trained context length of 40,960 tokens (40K). The KV cache grows with the context you use: about 1.2 GB at 8K and 4.8 GB at 32K.
Where can I download Qwen3 4B Text Encoder DHQ GGUF?
The files are on Hugging Face in the pottokao/Qwen3-4B-Text-Encoder-DHQ-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does Qwen3 4B Text Encoder DHQ use?
Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run Qwen3 4B Text Encoder DHQ on 8 GB VRAM?
Yes, the model requires about 4.6 GB of VRAM at 8 k context, so 8 GB is sufficient.
Does this model support image input?
No, it is a text encoder only and does not process images.
What license applies to this model?
The model is released under the apache‑2.0 license.