PH

phonon 40m multilingual

PhononGGUF by gradiumUpdated 2026-10-22
Download on Hugging Face
Parameters51M
Context—
Layers—
Architecture—
Smallest quant0.1 GB
Quick answer

phonon 40m multilingual needs about 0.6 GB of memory at its main file (a 0.1 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 2 quants, from 0.1 GB to 0.1 GB.

Phonon 40M multilingual model in GGUF format

Phonon 40M multilingual is a 0.0505 billion parameter model available as GGUF files. It is licensed under cc‑by‑nc‑4.0 and can be run with llama.cpp.

Good at

  • Multilingual text generation
  • Low‑resource inference
  • Open‑source usage

Limits

  • No vision support
  • License restricts commercial use
  • Context length not specified

Best for

  • Chatbots on edge devices
  • Educational tools
  • Rapid prototyping

Who it’s for. Developers needing a small, multilingual LLM for non‑commercial projects. Suitable for hobbyists and researchers who prefer open‑source models.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
—0.1 GB 0.6 GB
Fits Get file →
—0.1 GB 0.6 GB
Fits Get file →

The smallest GGUF file is 0.06 GB with an estimated memory usage of 0.6 GB at 8 k context. This is suitable for systems with 1 GB VRAM or less. The 0.07 GB file offers similar performance with a slightly larger memory footprint.

What GPU do you need for phonon 40m multilingual?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).

Specifications

Architecture from the GGUF header

Parameters51M

Source

Quantized bygradium
FamilyPhonon
Downloads (HF)6,258
Last updated2026-10-22

Frequently asked questions about phonon 40m multilingual

How much VRAM does phonon 40m multilingual need?

About 0.6 GB at its main file with an 8K context window. That is the 0.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run phonon 40m multilingual on an 8 GB GPU?

Yes, with the smaller files: the 0.1 GB file needs about 0.6 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of phonon 40m multilingual GGUF?

It depends on the quant: file is 0.1 GB, file is 0.1 GB.

Where can I download phonon 40m multilingual GGUF?

The files are on Hugging Face in the gradium/phonon-40m-multilingual repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does phonon 40m multilingual use?

Hugging Face lists the license as cc-by-nc-4.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 1 GB VRAM?

Yes, the 0.06 GB GGUF file requires about 0.6 GB of VRAM at 8 k context, fitting within a 1 GB budget.

Is this model suitable for commercial use?

No, the cc‑by‑nc‑4.0 license prohibits commercial use without permission.

Does this model support image inputs?

No, the model has no vision capabilities.

Similar models

Browse all →

More from gradium

All by gradium →

More Phonon models

All Phonon →

Other tiny models

All tiny models →