Artemis 31B v1.2 NVFP4 needs about 52.0 GB of memory at its main file (a 19.3 GB file) with an 8K context window, which is more than a 48 GB GPU holds. Longer context needs more: at 32K tokens the KV cache alone adds about 128.8 GB.
Artemis 31B v1.2 NVFP4 – a 30.7B Gemma4 text model in GGUF format
Artemis 31B v1.2 NVFP4 is a 30.7B parameter Gemma4 fine‑tune converted to GGUF with NVIDIA NVFP4 quantization. It supports 262144 token context and is optimized for reasoning and tool use. The model is available through the FaustianDeal repository on Hugging Face.
Good at
- Reasoning with high fidelity
- Tool calling and integration
- Creative role‑play dialogue
Limits
- No vision or audio support
- Requires large VRAM (≈52 GB at 8 k context)
- License terms not specified
Best for
- Complex reasoning tasks
- Creative writing and RP
- Tool‑enabled workflows
Who it’s for. Developers and writers who need a large, reasoning‑capable Gemma4 model for local inference. The model is suited for users with high‑end GPUs and a need for detailed context handling.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 19.3 GB | 52.0 GB | Too big | Get file → |
The only available quant is NVFP4, 19.31 GB in size. It requires roughly 52 GB of VRAM at 8 k context, so it is best run on GPUs with 64 GB or more. For lower VRAM budgets, a different quantization would be needed, but none is provided here.
What GPU do you need for Artemis 31B v1.2 NVFP4?
These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: no quant fits at an 8K context.
- 12 GB VRAM: no quant fits at an 8K context.
- 16 GB VRAM: no quant fits at an 8K context.
- 24 GB VRAM: no quant fits at an 8K context.
- 32 GB VRAM: no quant fits at an 8K context.
- 48 GB VRAM: no quant fits at an 8K context.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Artemis 31B v1.2 NVFP4
How much VRAM does Artemis 31B v1.2 NVFP4 need?
About 52.0 GB at its main file with an 8K context window. That is the 19.3 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Artemis 31B v1.2 NVFP4 on an 8 GB GPU?
Not at an 8K context. The smallest file needs about 52.0 GB, so you would need a larger GPU or CPU offloading.
What is the file size of Artemis 31B v1.2 NVFP4 GGUF?
It depends on the quant: file is 19.3 GB.
What context length does Artemis 31B v1.2 NVFP4 support?
The GGUF header lists a trained context length of 262,144 tokens (256K). The KV cache grows with the context you use: about 32.2 GB at 8K and 128.8 GB at 32K.
Where can I download Artemis 31B v1.2 NVFP4 GGUF?
The files are on Hugging Face in the FaustianDeal/Artemis-31B-v1.2-NVFP4-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
Can I run Artemis 31B v1.2 NVFP4 on 8 GB VRAM?
No. The model requires about 52 GB of VRAM at 8 k context, so 8 GB is insufficient.
Does this model support image input?
No. The GGUF file contains only text weights; use the separate Gemma4 31B vision tower for image recognition.
What is the context length of this model?
It supports up to 262144 tokens, as specified in the trained context tokens field.