Naphula Goetia 26B A4B v1.7 needs about 26.5 GB of memory at Q6_K (a 23.2 GB file) with an 8K context window, so it fits on a 32 GB GPU. This repository has 4 quants, from 0.1 GB to 52.0 GB (BF16).
Naphula Goetia 26B A4B v1.7 – a compact 14‑parameter LLM
Naphula Goetia 26B A4B v1.7 is a 14‑parameter model released under apache‑2.0. It is available in several GGUF quantizations and can be run with llama.cpp. The model is small enough for low‑end hardware but still offers a wide range of language capabilities.
Good at
- Creative text generation
- Conversational dialogue
- Story writing
Limits
- No vision support
- Limited context length
- Requires 8k context for memory estimates
Best for
- Chatbots on laptops
- Lightweight content creation
- Educational tutoring
Who it’s for. Developers and hobbyists who need a small, open‑source language model that can run on modest GPUs. The model is suitable for experimentation and low‑budget deployments.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 0.1 GB | 0.6 GB | Fits | Get file → | |
| Q6_K | 23.2 GB | 26.5 GB | Too big | Get file → | |
| Q8_0 | 27.6 GB | 31.5 GB | Too big | Get file → | |
| BF16 | 52.0 GB (2 parts) | 58.7 GB | Too big | Get file → |
For 8 GB VRAM, use Q6_K (23.24 GB file, 26.5 GB memory at 8k). For 12 GB VRAM, Q8_0 (27.64 GB file, 31.5 GB memory). If you have 16+ GB VRAM, BF16 split into two shards (51.98 GB file, 58.7 GB memory) gives the highest quality.
What GPU do you need for Naphula Goetia 26B A4B v1.7?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).
- 6 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).
- 8 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).
- 12 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).
- 16 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).
- 24 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).
- 32 GB VRAM: the best quant that fits is Q8_0 (27.6 GB file, about 31.5 GB in use).
- 48 GB VRAM: the best quant that fits is Q8_0 (27.6 GB file, about 31.5 GB in use).
Which Naphula Goetia 26B A4B v1.7 quant should you choose?
Q6_K (23.2 GB) is the middle option in this repository. Very close to the original quality for most uses, at a clearly larger size than 4-bit.
If memory is tight, the smallest file is the first one in the table at 0.1 GB, with the quality trade-offs that come with fewer bits.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Naphula Goetia 26B A4B v1.7
How much VRAM does Naphula Goetia 26B A4B v1.7 need?
About 26.5 GB at Q6_K with an 8K context window. That is the 23.2 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Naphula Goetia 26B A4B v1.7 on an 8 GB GPU?
Yes, with the smaller files: the 0.1 GB file needs about 0.6 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of Naphula Goetia 26B A4B v1.7 GGUF?
It depends on the quant: file is 0.1 GB, Q6_K is 23.2 GB, Q8_0 is 27.6 GB, BF16 is 52.0 GB.
Where can I download Naphula Goetia 26B A4B v1.7 GGUF?
The files are on Hugging Face in the Koshkasa/Naphula_Goetia-26B-A4B-v1.7-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does Naphula Goetia 26B A4B v1.7 use?
Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run Q6_K on 8 GB VRAM?
Yes, Q6_K requires about 26.5 GB memory at 8k context, so it fits within 8 GB VRAM with efficient batching.
Does the model support image input?
No, the model has no vision capabilities.
What license applies?
The model is released under the apache‑2.0 license.