ThinkingCap Qwen3.8 27B MIX needs about 0.5 GB of memory at its main file (a 0.0 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 2 quants, from 0.0 GB to 13.4 GB (IQ4_XS).
ThinkingCap Qwen3.8 27B MIX – a mixed‑tensor IQ4 quant of Qwen3.8‑27B
ThinkingCap Qwen3.8 27B MIX is a custom mixed‑tensor IQ4 quantization of the Qwen3.8‑27B base model. It retains the base model’s answer quality while reducing token usage. The file is 13.40 GB and embeds the MTP head for single‑file decoding.
Good at
- Efficient token usage
- Embedded MTP head
- Reduced file size
Limits
- No vision support without mmproj
- Requires 8 k context for memory estimate
- License is other
Best for
- Local inference on 8 k context
- Fine‑tuning with reduced memory
- Single‑file deployment
Who it’s for. Developers who need a smaller Qwen3.8‑27B model for local inference and want to avoid a second file for the MTP head. It is suitable for users with limited storage but sufficient VRAM for 8 k context.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 0.0 GB | 0.5 GB | Fits | Get file → | |
| IQ4_XS | 13.4 GB | 15.5 GB | Too big | Get file → |
For 8 k context, the IQ4_XS quant uses 15.5 GB of VRAM. If you have a tighter memory budget, the unknown quant file is 0.01 GB but its memory usage is not specified. Use the IQ4_XS quant for reliable performance.
What GPU do you need for ThinkingCap Qwen3.8 27B MIX?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
- 6 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
- 8 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
- 12 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
- 16 GB VRAM: the best quant that fits is IQ4_XS (13.4 GB file, about 15.5 GB in use).
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about ThinkingCap Qwen3.8 27B MIX
How much VRAM does ThinkingCap Qwen3.8 27B MIX need?
About 0.5 GB at its main file with an 8K context window. That is the 0.0 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run ThinkingCap Qwen3.8 27B MIX on an 8 GB GPU?
Yes, with the smaller files: the 0.0 GB file needs about 0.5 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of ThinkingCap Qwen3.8 27B MIX GGUF?
It depends on the quant: file is 0.0 GB, IQ4_XS is 13.4 GB.
Where can I download ThinkingCap Qwen3.8 27B MIX GGUF?
The files are on Hugging Face in the vmarcelo/ThinkingCap-Qwen3.8-27B-MIX_GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does ThinkingCap Qwen3.8 27B MIX use?
Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run this model on 8 GB VRAM?
The IQ4_XS quant estimates 15.5 GB of VRAM at 8 k context, so 8 GB is insufficient.
Does this model support vision?
Vision requires an mmproj file; the model itself does not include vision support.
Is the MTP head separate?
The MTP head is embedded in the file, so no separate file is needed.