CYBER-FROST-3.8-PS-GUFF needs about 113.9 GB of memory at Q5_K_M (a 112.5 GB file) with an 8K context window, which is more than a 48 GB GPU holds. Longer context needs more: at 32K tokens the KV cache alone adds about 3.3 GB.
Cyber-Frost 3.8 security‑tuned Qwen4-Exp MoE model quantized to Q5_K_M
CYBER-FROST-3.8-PS-GUFF is a 180‑billion‑parameter Qwen4-Exp MoE model tailored for cybersecurity tasks. It was quantized by peasantsmith to a mixed‑precision Q5_K_M GGUF file. The model supports tool usage and was trained on 262144 context tokens.
Good at
- Tool‑based security workflows
- Large‑context analysis
- Cyber‑security‑specific language
Limits
- No vision support
- Requires 113.9 GB VRAM at 8 k context
- License type is other
Best for
- Red/blue team simulations
- Vulnerability analysis
- Security incident response
Who it’s for. Security professionals performing authorized research, assessment, engineering, and response work. The model is designed to reduce friction in professional cybersecurity workflows.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| Q5_K_M | 112.5 GB | 113.9 GB | Too big | Get file → |
For 8 GB VRAM use a lower‑precision quant if available. The only provided quant is Q5_K_M, which requires about 113.9 GB VRAM at 8 k context. Memory estimates are approximate.
What GPU do you need for CYBER-FROST-3.8-PS-GUFF?
These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: no quant fits at an 8K context.
- 12 GB VRAM: no quant fits at an 8K context.
- 16 GB VRAM: no quant fits at an 8K context.
- 24 GB VRAM: no quant fits at an 8K context.
- 32 GB VRAM: no quant fits at an 8K context.
- 48 GB VRAM: no quant fits at an 8K context.
Which CYBER-FROST-3.8-PS-GUFF quant should you choose?
Q5_K_M (112.5 GB) is the middle option in this repository. Closer to the original model than 4-bit, for a moderate increase in size. A good pick when you have memory to spare.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about CYBER-FROST-3.8-PS-GUFF
How much VRAM does CYBER-FROST-3.8-PS-GUFF need?
About 113.9 GB at Q5_K_M with an 8K context window. That is the 112.5 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run CYBER-FROST-3.8-PS-GUFF on an 8 GB GPU?
Not at an 8K context. The smallest file needs about 113.9 GB, so you would need a larger GPU or CPU offloading.
What is the file size of CYBER-FROST-3.8-PS-GUFF GGUF?
It depends on the quant: Q5_K_M is 112.5 GB.
What context length does CYBER-FROST-3.8-PS-GUFF support?
The GGUF header lists a trained context length of 262,144 tokens (256K). The KV cache grows with the context you use: about 0.8 GB at 8K and 3.3 GB at 32K.
Where can I download CYBER-FROST-3.8-PS-GUFF GGUF?
The files are on Hugging Face in the peasantsmith/CYBER-FROST-3.8-PS-GUFF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does CYBER-FROST-3.8-PS-GUFF use?
Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run CYBER-FROST-3.8-PS-GUFF on 8 GB VRAM?
No. The Q5_K_M quant requires approximately 113.9 GB VRAM at 8 k context.
Does this model support image or video input?
No. The release has not received a multimodal quality evaluation.
What is the context length of this model?
It was trained on 262144 context tokens.