Qwythos 9B Claude Mythos 5 1M MTP needs about 7.9 GB of memory at Q5_K_M (a 6.3 GB file) with an 8K context window, so it fits on a 8 GB GPU. This repository has 2 quants, from 6.3 GB (Q5_K_M) to 6.9 GB (Q5_K_M). Longer context needs more: at 32K tokens the KV cache alone adds about 4.4 GB.
Qwythos 9B Claude Mythos 5 1M MTP – a 9.2B reasoning model with 1M‑token context and vision support
Qwythos 9B is a full‑parameter reasoning model built on Qwen3.5‑9B and post‑trained on Claude Mythos traces. It offers a 1,048,576‑token context window, native function calling, and multi‑token prediction for speculative decoding.
Good at
- Reasoning across long contexts
- Tool‑enabled self‑correction
- Vision inference
Limits
- Requires high VRAM for 1M context
- Large context limits use of smaller GPUs
- No language restrictions listed
Best for
- Long‑form codebase analysis
- Multi‑document research
- Agentic task planning
Who it’s for. Developers and researchers needing deep reasoning, tool integration, and vision capabilities in a single 9B model. Suitable for applications that demand long context windows and uncensored responses.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| Q5_K_M | 6.3 GB | 7.9 GB | Tight | Get file → | |
| Q5_K_M | 6.9 GB | 8.5 GB | Too big | Get file → |
For 8 GB VRAM, use the 6.27 GB Q5_K_M file (≈7.9 GB memory at 8 k context). For 10 GB VRAM, use the 6.88 GB Q5_K_M file (≈8.5 GB memory at 8 k context). Both are selective hybrid quants.
What GPU do you need for Qwythos 9B Claude Mythos 5 1M MTP?
These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: the best quant that fits is Q5_K_M (6.3 GB file, about 7.9 GB in use).
- 12 GB VRAM: the best quant that fits is Q5_K_M (6.9 GB file, about 8.5 GB in use).
Which Qwythos 9B Claude Mythos 5 1M MTP quant should you choose?
Q5_K_M (6.3 GB) is the middle option in this repository. Closer to the original model than 4-bit, for a moderate increase in size. A good pick when you have memory to spare.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Qwythos 9B Claude Mythos 5 1M MTP
How much VRAM does Qwythos 9B Claude Mythos 5 1M MTP need?
About 7.9 GB at Q5_K_M with an 8K context window. That is the 6.3 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Qwythos 9B Claude Mythos 5 1M MTP on an 8 GB GPU?
Yes, with Q5_K_M: the 6.3 GB file needs about 7.9 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of Qwythos 9B Claude Mythos 5 1M MTP GGUF?
It depends on the quant: Q5_K_M is 6.3 GB, Q5_K_M is 6.9 GB.
What context length does Qwythos 9B Claude Mythos 5 1M MTP support?
The GGUF header lists a trained context length of 1,048,576 tokens (1024K). The KV cache grows with the context you use: about 1.1 GB at 8K and 4.4 GB at 32K.
Where can I download Qwythos 9B Claude Mythos 5 1M MTP GGUF?
The files are on Hugging Face in the wepiqx/Qwythos-9B-Claude-Mythos-5-1M-MTP-SHQ8-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does Qwythos 9B Claude Mythos 5 1M MTP use?
Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run Qwythos 9B on 8 GB VRAM?
Yes, the 6.27 GB Q5_K_M quant uses about 7.9 GB memory at 8 k context, fitting within an 8 GB VRAM budget.
Does the model support vision?
Yes, the model includes vision support as part of its detected abilities.
Is the model censored?
No, Qwythos is intentionally uncensored and designed for technical domains.