SE

SenseVoiceSmall GGUF audiocpp

SensevoicesmallGGUF by FunAudioLLMUpdated 2026-08-12
Download on Hugging Face
Parameters234M
Context—
Layers—
Architecturesensevoice-small
Smallest quant0.3 GB
Quick answer

SenseVoiceSmall GGUF audiocpp needs about 0.8 GB of memory at its main file (a 0.3 GB file) with an 8K context window, so it fits on a 4 GB GPU.

SenseVoiceSmall GGUF for audio.cpp – lightweight ASR model

SenseVoiceSmall GGUF is a 0.234 billion‑parameter ASR model exported for audio.cpp. It uses the sense_asr schema‑v1 and includes SentencePiece vocabulary, CMVN tensors, and 919 model tensors. The export is Q8_0 and loads directly without model‑spec override.

Good at

  • Low‑memory ASR inference
  • Fast CPU decoding
  • Compact file size

Limits

  • No vision support
  • No external model spec needed
  • Requires audio.cpp runtime

Best for

  • Embedded speech recognition
  • Edge device ASR
  • Low‑latency transcription

Who it’s for. Developers building speech‑to‑text solutions on resource‑constrained devices. Suitable for projects needing a small, fast ASR model without GPU requirements.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
—0.3 GB 0.8 GB
Fits Get file →

The only available quant is Q8_0, 0.25 GB in size. It requires about 0.8 GB of RAM at 8 k context. For 8 GB VRAM devices, this model fits comfortably in VRAM and can be run on CPU or GPU.

What GPU do you need for SenseVoiceSmall GGUF audiocpp?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is the main file (0.3 GB file, about 0.8 GB in use).

Specifications

Architecture from the GGUF header

Architecturesensevoice-small
Parameters234M

Source

Quantized byFunAudioLLM
Licenseapache-2.0
Downloads (HF)40,356
Last updated2026-08-12

Frequently asked questions about SenseVoiceSmall GGUF audiocpp

How much VRAM does SenseVoiceSmall GGUF audiocpp need?

About 0.8 GB at its main file with an 8K context window. That is the 0.3 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run SenseVoiceSmall GGUF audiocpp on an 8 GB GPU?

Yes, with the smaller files: the 0.3 GB file needs about 0.8 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of SenseVoiceSmall GGUF audiocpp GGUF?

It depends on the quant: file is 0.3 GB.

Where can I download SenseVoiceSmall GGUF audiocpp GGUF?

The files are on Hugging Face in the FunAudioLLM/SenseVoiceSmall-GGUF-audiocpp repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does SenseVoiceSmall GGUF audiocpp use?

Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run SenseVoiceSmall on 8 GB VRAM?

Yes. The 0.25 GB GGUF file and 0.8 GB RAM requirement fit easily within 8 GB VRAM, allowing CPU or GPU inference.

What license does SenseVoiceSmall use?

The model is released under the Apache‑2.0 license.

Does this model support multiple languages?

The model has no listed languages; it is a generic ASR model without specified language support.

Similar models

Browse all →

More from FunAudioLLM

All by FunAudioLLM →

More Sensevoicesmall models

All Sensevoicesmall →

Other tiny models

All tiny models →