PH

phonon 40m pt

PhononGGUF by gradiumUpdated 2026-10-29
Download on Hugging Face
Parameters51M
Context—
Layers—
Architecture—
Smallest quant0.1 GB
Quick answer

phonon 40m pt needs about 0.6 GB of memory at its main file (a 0.1 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 2 quants, from 0.1 GB to 0.1 GB.

Small 50M parameter LLM for lightweight inference

Phonon 40m pt is a 0.0505 billion parameter model released under a cc‑by‑nc‑4.0 license. It is available in GGUF format with two file sizes, 0.06 GB and 0.07 GB, each estimating 0.6 GB of VRAM at an 8 k context length.

Good at

  • Quick inference on low‑memory GPUs
  • Simple text generation
  • Lightweight prototyping

Limits

  • No vision or multimodal support
  • License restricts commercial use
  • Small context handling not specified

Best for

  • Embedded devices
  • Rapid prototyping
  • Educational demos

Who it’s for. Developers needing a compact, non‑commercial LLM for quick experiments or low‑resource deployments. Suitable for educational projects and proof‑of‑concepts where large models are impractical.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
—0.1 GB 0.6 GB
Fits Get file →
—0.1 GB 0.6 GB
Fits Get file →

For 8 GB VRAM, either 0.06 GB or 0.07 GB GGUF file will fit comfortably, using about 0.6 GB of VRAM at 8 k context. Choose the smaller file for slightly lower memory usage. Both files are unquantized, so performance will be consistent.

What GPU do you need for phonon 40m pt?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).

Specifications

Architecture from the GGUF header

Parameters51M

Source

Quantized bygradium
FamilyPhonon
Downloads (HF)5,825
Last updated2026-10-29

Frequently asked questions about phonon 40m pt

How much VRAM does phonon 40m pt need?

About 0.6 GB at its main file with an 8K context window. That is the 0.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run phonon 40m pt on an 8 GB GPU?

Yes, with the smaller files: the 0.1 GB file needs about 0.6 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of phonon 40m pt GGUF?

It depends on the quant: file is 0.1 GB, file is 0.1 GB.

Where can I download phonon 40m pt GGUF?

The files are on Hugging Face in the gradium/phonon-40m-pt repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does phonon 40m pt use?

Hugging Face lists the license as cc-by-nc-4.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 8 GB VRAM?

Yes, both GGUF files require only about 0.6 GB of VRAM at 8 k context, leaving ample room on an 8 GB GPU.

Is this model suitable for commercial use?

No, the cc‑by‑nc‑4.0 license prohibits commercial use without permission.

Does this model support vision tasks?

No, it is a text‑only model with no vision or multimodal capabilities.

Similar models

Browse all →

More from gradium

All by gradium →

More Phonon models

All Phonon →

Other tiny models

All tiny models →