Doggy needs about 17.8 GB of memory at its main file (a 15.4 GB file) with an 8K context window, so it fits on a 24 GB GPU. This repository has 2 quants, from 15.4 GB to 15.4 GB.
Doggy: a 14.3B parameter wan architecture model
Doggy is a 14.3B parameter model built on the wan architecture. It is available in GGUF format with a file size of 15.41 GB. No additional context or language information is provided.
Good at
- Large language modeling
- General-purpose text generation
- High parameter count
Limits
- No license information
- No context token count provided
- No vision support
Best for
- Research on large language models
- Benchmarking new inference engines
- Exploring wan architecture
Who it’s for. Researchers and developers interested in large language models with a wan architecture. The model is suitable for those who can handle a 15.41 GB GGUF file and have sufficient memory for inference.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 15.4 GB | 17.8 GB | Too big | Get file → | |
| — | 15.4 GB | 17.8 GB | Too big | Get file → |
The provided GGUF files are listed as "unknown" quantization. They require approximately 17.8 GB of memory at an 8 k context length. If you have 8 GB VRAM, this model will not fit. Consider using a model with a smaller quantization or a different architecture.
What GPU do you need for Doggy?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: no quant fits at an 8K context.
- 12 GB VRAM: no quant fits at an 8K context.
- 16 GB VRAM: no quant fits at an 8K context.
- 24 GB VRAM: the best quant that fits is the main file (15.4 GB file, about 17.8 GB in use).
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Doggy
How much VRAM does Doggy need?
About 17.8 GB at its main file with an 8K context window. That is the 15.4 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Doggy on an 8 GB GPU?
Not at an 8K context. The smallest file needs about 17.8 GB, so you would need a larger GPU or CPU offloading.
What is the file size of Doggy GGUF?
It depends on the quant: file is 15.4 GB, file is 15.4 GB.
Where can I download Doggy GGUF?
The files are on Hugging Face in the NoahWat/Doggy repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
Can I run Doggy on 8 GB VRAM?
No, the model requires about 17.8 GB of memory at 8 k context, which exceeds 8 GB VRAM.
What is the file size of the Doggy GGUF model?
The GGUF file size is 15.41 GB.
Does Doggy support vision tasks?
No vision support is indicated for this model.