moziAI 27B MTP needs about 16.4 GB of memory at Q4_K_M (a 13.7 GB file) with an 8K context window, so it fits on a 24 GB GPU. Longer context needs more: at 32K tokens the KV cache alone adds about 8.7 GB.
MoziAI 27B MTP – a multimodal 27B model with vision and tool use
MoziAI 27B MTP is a 27.3B parameter dense model based on Qwen3.8-27B. It supports vision, tool use, and dynamic seven‑dimensional thinking. The model is released under Apache‑2.0 and can be run locally on consumer GPUs.
Good at
- Vision‑language tasks
- Tool‑enabled reasoning
- Dynamic multi‑step planning
Limits
- Requires ~16.4 GB VRAM at 8 k context
- No native support for other modalities beyond vision
- No external benchmark data provided
Best for
- Local multimodal inference
- Financial domain applications
- Agentic task automation
Who it’s for. Developers and enterprises needing a free, commercial‑use multimodal model that runs locally. The model is suitable for users with GPUs that can accommodate the memory requirement and who want to avoid cloud token costs.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| Q4_K_M | 13.7 GB | 16.4 GB | Too big | Get file → |
The only available quantization is Q4_K_M, file size 13.74 GB. It requires approximately 16.4 GB VRAM at 8 k context. For 8 GB VRAM users, the model cannot be loaded in full. If a smaller quant is needed, it is not provided in the file list.
What GPU do you need for moziAI 27B MTP?
These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: no quant fits at an 8K context.
- 12 GB VRAM: no quant fits at an 8K context.
- 16 GB VRAM: no quant fits at an 8K context.
- 24 GB VRAM: the best quant that fits is Q4_K_M (13.7 GB file, about 16.4 GB in use).
Which moziAI 27B MTP quant should you choose?
Q4_K_M is the usual starting point for moziAI 27B MTP: it balances file size and quality well. Here it is a 13.7 GB file.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about moziAI 27B MTP
How much VRAM does moziAI 27B MTP need?
About 16.4 GB at Q4_K_M with an 8K context window. That is the 13.7 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run moziAI 27B MTP on an 8 GB GPU?
Not at an 8K context. The smallest file needs about 16.4 GB, so you would need a larger GPU or CPU offloading.
What is the file size of moziAI 27B MTP GGUF?
It depends on the quant: Q4_K_M is 13.7 GB.
What context length does moziAI 27B MTP support?
The GGUF header lists a trained context length of 262,144 tokens (256K). The KV cache grows with the context you use: about 2.2 GB at 8K and 8.7 GB at 32K.
Where can I download moziAI 27B MTP GGUF?
The files are on Hugging Face in the chenyumo/moziAI-27B-MTP repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does moziAI 27B MTP use?
Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run MoziAI 27B MTP on 8 GB VRAM?
No. The Q4_K_M quant requires about 16.4 GB VRAM at 8 k context. 8 GB VRAM is insufficient.
Does MoziAI 27B MTP support vision?
Yes. The model includes a vision encoder and can process images and videos.
Is MoziAI 27B MTP free for commercial use?
Yes. It is licensed under Apache‑2.0 and allows free commercial deployment.