ZIT Checkpoints needs about 7.8 GB of memory at its main file (a 6.5 GB file) with an 8K context window, so it fits on a 8 GB GPU. This repository has 2 quants, from 6.5 GB to 6.5 GB.
ZIT Checkpoints – a lumina2 architecture model
ZIT Checkpoints is a lumina2 model from the Zit family. The model is available in GGUF format with a file size of 6.54 GB. Estimated VRAM usage is 7.8 GB at an 8k context length.
Good at
- General language understanding
- Text generation
- Contextual responses
Limits
- No quantization options provided
- Requires 7.8 GB VRAM at 8k context
- No license information available
Best for
- Developers needing a large language model
- Researchers testing lumina2 architecture
- Applications with ample GPU memory
Who it’s for. This model is suitable for users with high‑end GPUs who can allocate around 8 GB of VRAM. It is intended for developers and researchers exploring the Zit family and lumina2 architecture.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 6.5 GB | 7.8 GB | Tight | Get file → | |
| — | 6.5 GB | 7.8 GB | Tight | Get file → |
The only available GGUF file is unquantized. It requires 7.8 GB of VRAM at 8k context. If your GPU has at least 8 GB VRAM, you can run the model directly. No other quantized variants are provided.
What GPU do you need for ZIT Checkpoints?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: the best quant that fits is the main file (6.5 GB file, about 7.8 GB in use).
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about ZIT Checkpoints
How much VRAM does ZIT Checkpoints need?
About 7.8 GB at its main file with an 8K context window. That is the 6.5 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run ZIT Checkpoints on an 8 GB GPU?
Yes, with the smaller files: the 6.5 GB file needs about 7.8 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of ZIT Checkpoints GGUF?
It depends on the quant: file is 6.5 GB, file is 6.5 GB.
Where can I download ZIT Checkpoints GGUF?
The files are on Hugging Face in the EllaPriest45/ZIT_Checkpoints repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
Can I run ZIT Checkpoints on 8 GB VRAM?
Yes, the model requires approximately 7.8 GB of VRAM at an 8k context length, so it fits within an 8 GB GPU.
Is there a smaller quantized version?
No, only the unquantized 6.54 GB GGUF file is available.
What license does ZIT Checkpoints use?
License information is not provided in the available data.