phonon 40m en needs about 0.6 GB of memory at its main file (a 0.1 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 2 quants, from 0.1 GB to 0.1 GB.
Phonon 40M English model for lightweight text generation
Phonon 40M is a small language model with 0.0505 billion parameters. It is available in GGUF format and can be run with llama.cpp. The model is licensed under cc‑by‑nc‑4.0.
Good at
- Lightweight English text generation
- Fast inference on low‑memory GPUs
- Suitable for educational demos
Limits
- No vision or multimodal support
- License restricts commercial use
- Context length not specified
Best for
- Embedding in mobile apps
- Rapid prototyping of chatbots
- Running on 8 GB VRAM systems
Who it’s for. Developers needing a small, non‑commercial English LLM for quick experiments or low‑resource deployments. The model is ideal for educational projects and hobbyist use.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 0.1 GB | 0.6 GB | Fits | Get file → | |
| — | 0.1 GB | 0.6 GB | Fits | Get file → |
The available GGUF files are 0.06 GB and 0.07 GB in size, each estimating about 0.6 GB of VRAM at 8 k context. For 8 GB VRAM, either file will fit comfortably. Use the 0.06 GB file for slightly lower memory usage.
What GPU do you need for phonon 40m en?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about phonon 40m en
How much VRAM does phonon 40m en need?
About 0.6 GB at its main file with an 8K context window. That is the 0.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run phonon 40m en on an 8 GB GPU?
Yes, with the smaller files: the 0.1 GB file needs about 0.6 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of phonon 40m en GGUF?
It depends on the quant: file is 0.1 GB, file is 0.1 GB.
Where can I download phonon 40m en GGUF?
The files are on Hugging Face in the gradium/phonon-40m-en repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does phonon 40m en use?
Hugging Face lists the license as cc-by-nc-4.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run Phonon 40M on 8 GB VRAM?
Yes, both GGUF files require only about 0.6 GB of VRAM at 8 k context, leaving ample headroom on an 8 GB GPU.
Is Phonon 40M suitable for commercial applications?
No. The cc‑by‑nc‑4.0 license prohibits commercial use.
Does Phonon 40M support vision or multimodal inputs?
No, the model has no vision or multimodal capabilities.