Z Image Qwen 3 4b text encoder needs about 4.0 GB of memory at IQ4_XS (a 2.3 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 7 quants, from 2.1 GB (Q3_K_M) to 8.1 GB. Longer context needs more: at 32K tokens the KV cache alone adds about 4.8 GB.
Z Image Qwen 3 4b text encoder – a lightweight text encoder for image generation
The Z Image Qwen 3 4b text encoder is a 4 billion‑parameter model based on the Qwen3 architecture. It is designed to encode text prompts for the Z‑Image image generation family. The model supports coding tasks and is available in several GGUF quantizations.
Good at
- Text prompt encoding for image generation
- Coding assistance
- Efficient inference with low VRAM
Limits
- No vision input support
- License not specified
- Requires 8 k context for estimates
Best for
- Encoding prompts for Z‑Image generation
- Fine‑tuning text encoders
- Low‑memory inference
Who it’s for. Developers building or fine‑tuning image generation pipelines that require a compact text encoder. It is suitable for users with limited VRAM who still need accurate prompt encoding for Z‑Image models.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| Q3_K_M | 2.1 GB | 3.8 GB | Fits | Get file → | |
| Q3_K_M | 2.1 GB | 3.8 GB | Fits | Get file → | |
| IQ4_XS | 2.3 GB | 4.0 GB | Fits | Get file → | |
| IQ4_XS | 2.3 GB | 4.0 GB | Fits | Get file → | |
| Q6_K | 3.3 GB | 5.0 GB | Fits | Get file → | |
| Q8_0 | 4.3 GB | 6.0 GB | Fits | Get file → | |
| — | 8.1 GB | 9.8 GB | Too big | Get file → |
For 8 GB VRAM, use Q3_K_M (2.08 GB, ~3.8 GB memory) or IQ4_XS (2.27 GB, ~4 GB memory). If 16 GB VRAM is available, Q6_K (3.31 GB, ~5 GB memory) or Q8_0 (4.28 GB, ~6 GB memory) provide higher precision. The unknown quant is larger and not recommended for low‑budget setups.
What GPU do you need for Z Image Qwen 3 4b text encoder?
These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is IQ4_XS (2.3 GB file, about 4.0 GB in use).
- 6 GB VRAM: the best quant that fits is Q8_0 (4.3 GB file, about 6.0 GB in use).
- 8 GB VRAM: the best quant that fits is Q8_0 (4.3 GB file, about 6.0 GB in use).
- 12 GB VRAM: the best quant that fits is the main file (8.1 GB file, about 9.8 GB in use).
Which Z Image Qwen 3 4b text encoder quant should you choose?
IQ4_XS (2.3 GB) is the middle option in this repository. The usual sweet spot between file size and quality, and the quant most people start with.
If memory is tight, the smallest file is Q3_K_M at 2.1 GB, with the quality trade-offs that come with fewer bits. A reasonable choice when a 4-bit file will not fit, mostly on larger models. Quality loss is noticeable but often acceptable.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Z Image Qwen 3 4b text encoder
How much VRAM does Z Image Qwen 3 4b text encoder need?
About 4.0 GB at IQ4_XS with an 8K context window. That is the 2.3 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Z Image Qwen 3 4b text encoder on an 8 GB GPU?
Yes, with Q8_0: the 4.3 GB file needs about 6.0 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of Z Image Qwen 3 4b text encoder GGUF?
It depends on the quant: Q3_K_M is 2.1 GB, Q3_K_M is 2.1 GB, IQ4_XS is 2.3 GB, IQ4_XS is 2.3 GB, Q6_K is 3.3 GB, Q8_0 is 4.3 GB and 1 more.
What context length does Z Image Qwen 3 4b text encoder support?
The GGUF header lists a trained context length of 40,960 tokens (40K). The KV cache grows with the context you use: about 1.2 GB at 8K and 4.8 GB at 32K.
Where can I download Z Image Qwen 3 4b text encoder GGUF?
The files are on Hugging Face in the worstplayer/Z-Image_Qwen_3_4b_text_encoder_GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
Can I run this model on 8 GB VRAM?
Yes, the Q3_K_M and IQ4_XS quantizations fit within 8 GB VRAM with approximate memory usage of 3.8–4 GB at 8 k context.
Does this model support image input?
No, the model is a text encoder only and does not process image data.
What is the recommended quant for best accuracy?
Q8_0 offers near‑identical results to FP16, but requires 4.28 GB file size and ~6 GB memory.