phonon 40m pt needs about 0.6 GB of memory at its main file (a 0.1 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 2 quants, from 0.1 GB to 0.1 GB.
Small 50M parameter LLM for lightweight inference
Phonon 40m pt is a 0.0505 billion parameter model released under a cc‑by‑nc‑4.0 license. It is available in GGUF format with two file sizes, 0.06 GB and 0.07 GB, each estimating 0.6 GB of VRAM at an 8 k context length.
Good at
- Quick inference on low‑memory GPUs
- Simple text generation
- Lightweight prototyping
Limits
- No vision or multimodal support
- License restricts commercial use
- Small context handling not specified
Best for
- Embedded devices
- Rapid prototyping
- Educational demos
Who it’s for. Developers needing a compact, non‑commercial LLM for quick experiments or low‑resource deployments. Suitable for educational projects and proof‑of‑concepts where large models are impractical.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 0.1 GB | 0.6 GB | Fits | Get file → | |
| — | 0.1 GB | 0.6 GB | Fits | Get file → |
For 8 GB VRAM, either 0.06 GB or 0.07 GB GGUF file will fit comfortably, using about 0.6 GB of VRAM at 8 k context. Choose the smaller file for slightly lower memory usage. Both files are unquantized, so performance will be consistent.
What GPU do you need for phonon 40m pt?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about phonon 40m pt
How much VRAM does phonon 40m pt need?
About 0.6 GB at its main file with an 8K context window. That is the 0.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run phonon 40m pt on an 8 GB GPU?
Yes, with the smaller files: the 0.1 GB file needs about 0.6 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of phonon 40m pt GGUF?
It depends on the quant: file is 0.1 GB, file is 0.1 GB.
Where can I download phonon 40m pt GGUF?
The files are on Hugging Face in the gradium/phonon-40m-pt repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does phonon 40m pt use?
Hugging Face lists the license as cc-by-nc-4.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run this model on 8 GB VRAM?
Yes, both GGUF files require only about 0.6 GB of VRAM at 8 k context, leaving ample room on an 8 GB GPU.
Is this model suitable for commercial use?
No, the cc‑by‑nc‑4.0 license prohibits commercial use without permission.
Does this model support vision tasks?
No, it is a text‑only model with no vision or multimodal capabilities.