Victoria Qsim Final needs about 108.5 GB of memory at its main file (a 107.2 GB file) with an 8K context window, which is more than a 48 GB GPU holds. This repository has 2 quants, from 107.2 GB to 155.2 GB. Longer context needs more: at 32K tokens the KV cache alone adds about 3.3 GB.
Compressed 4‑bit Qwen3.8‑Flash‑Next derivative with 126 B parameters
Victoria is a 4‑bit compressed version of Qwen3.8‑Flash‑Next. It retains 5.9 B active parameters per token and runs on a single GPU. The model was retrained after removing 44 % of experts to preserve quality.
Good at
- Fast decode on single GPU
- Maintains most coding and agent abilities
- Efficient 4‑bit inference
Limits
- Large context window of 262144 tokens
- Requires 48.0 GiB weights plus 95.4 GiB n‑gram table
- No vision support
Best for
- Single‑GPU inference
- Agentic workloads with long context
- Fine‑tuning on limited hardware
Who it’s for. Developers needing a lightweight Qwen3.8‑Flash‑Next model for single‑GPU inference. Researchers wanting to experiment with a 4‑bit compressed architecture while preserving most of the original model’s capabilities.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 107.2 GB (3 parts) | 108.5 GB | Too big | Get file → | |
| — | 155.2 GB (3 parts) | 156.5 GB | Too big | Get file → |
For a single‑GPU setup, use the GGUF Q4_K_M build which holds 49.17 GiB of weights. If you have more VRAM, the NVFP4 build offers faster decode but requires a Blackwell GPU. Memory estimates are approximate and based on the provided file sizes.
What GPU do you need for Victoria Qsim Final?
These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: no quant fits at an 8K context.
- 12 GB VRAM: no quant fits at an 8K context.
- 16 GB VRAM: no quant fits at an 8K context.
- 24 GB VRAM: no quant fits at an 8K context.
- 32 GB VRAM: no quant fits at an 8K context.
- 48 GB VRAM: no quant fits at an 8K context.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Victoria Qsim Final
How much VRAM does Victoria Qsim Final need?
About 108.5 GB at its main file with an 8K context window. That is the 107.2 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Victoria Qsim Final on an 8 GB GPU?
Not at an 8K context. The smallest file needs about 108.5 GB, so you would need a larger GPU or CPU offloading.
What is the file size of Victoria Qsim Final GGUF?
It depends on the quant: file is 107.2 GB, file is 155.2 GB.
What context length does Victoria Qsim Final support?
The GGUF header lists a trained context length of 262,144 tokens (256K). The KV cache grows with the context you use: about 0.8 GB at 8K and 3.3 GB at 32K.
Where can I download Victoria Qsim Final GGUF?
The files are on Hugging Face in the rmonsurate/Victoria repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does Victoria Qsim Final use?
Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run Victoria on 8 GB VRAM?
No. The GGUF build requires at least 49.17 GiB of VRAM, and the NVFP4 build needs a Blackwell GPU with more memory.
Does Victoria support vision tasks?
No. The model has no vision capabilities.
What context length does Victoria support?
It supports up to 262144 tokens, matching its trained context window.