flux2 klein 4B uncensored text encoder needs about 3.2 GB of memory at Q4_0 (a 2.4 GB file) with an 8K context window, so it fits on a 4 GB GPU.
Flux2 Klein 4B Uncensored Text Encoder – 4B Qwen-based model
Flux2 Klein 4B Uncensored Text Encoder is a 4‑billion parameter Qwen family model. It is designed for text encoding tasks and supports coding abilities. The model is released under the Apache‑2.0 license.
Good at
- Coding tasks
- Text encoding
- Uncensored content
Limits
- No vision support
- Context length not specified
- Requires 8‑k context for memory estimate
Best for
- Code generation
- Text embedding
- Developer tooling
Who it’s for. Engineers and researchers who need a lightweight text encoder for coding applications. The model is suitable for integration into local LLM pipelines that require a Qwen-based encoder.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| Q4_0 | 2.4 GB | 3.2 GB | Fits | Get file → |
For 8‑GB VRAM, use the Q4_0 quantized file (2.37 GB). It requires approximately 3.2 GB of VRAM at 8‑k context. For larger VRAM budgets, higher‑precision quants are not listed.
What GPU do you need for flux2 klein 4B uncensored text encoder?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is Q4_0 (2.4 GB file, about 3.2 GB in use).
Which flux2 klein 4B uncensored text encoder quant should you choose?
Q4_0 (2.4 GB) is the middle option in this repository. The usual sweet spot between file size and quality, and the quant most people start with.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about flux2 klein 4B uncensored text encoder
How much VRAM does flux2 klein 4B uncensored text encoder need?
About 3.2 GB at Q4_0 with an 8K context window. That is the 2.4 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run flux2 klein 4B uncensored text encoder on an 8 GB GPU?
Yes, with Q4_0: the 2.4 GB file needs about 3.2 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of flux2 klein 4B uncensored text encoder GGUF?
It depends on the quant: Q4_0 is 2.4 GB.
Where can I download flux2 klein 4B uncensored text encoder GGUF?
The files are on Hugging Face in the Cordux/flux2-klein-4B-uncensored-text-encoder repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does flux2 klein 4B uncensored text encoder use?
Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run this model on 8 GB VRAM?
Yes, the Q4_0 quantized file is 2.37 GB and requires about 3.2 GB of VRAM at 8‑k context.
Does this model support vision tasks?
No, the model has no vision support.
What license does it use?
Apache‑2.0.