NE

.nemotron-speech-streaming-en-0.6b.q8_0.gguf

NemotronGGUF by nvidiaUpdated 2026-08-05
Download on Hugging Face
Parameters628M
Context—
Layers—
Architectureasr
Smallest quant0.7 GB
Quick answer

.nemotron-speech-streaming-en-0.6b.q8_0.gguf needs about 1.3 GB of memory at Q8_0 (a 0.7 GB file) with an 8K context window, so it fits on a 4 GB GPU.

NVIDIA Nemotron 0.6B ASR Streaming – 600M‑parameter English speech-to-text

Nemotron-ASR-Streaming is a 0.6 B parameter model for English automatic speech recognition. It supports low‑latency streaming and batch transcription with native punctuation and capitalization. The model uses a Cache‑Aware FastConformer‑RNNT architecture for efficient processing.

Good at

  • Low‑latency streaming transcription
  • High‑throughput batch processing
  • Native punctuation and capitalization

Limits

  • No vision support
  • No multilingual capability in this checkpoint
  • License type is other

Best for

  • Real‑time voice assistants
  • Transcribing podcasts or meetings
  • Batch transcription of audio files

Who it’s for. Developers building English‑only voice interfaces or transcription services that require low latency and high accuracy. The model is suitable for applications where native punctuation and capitalization are needed without additional post‑processing.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
Q8_00.7 GB 1.3 GB
Fits Get file →

The Q8_0 quantization file is 0.7 GB and requires about 1.3 GB of VRAM at 8 k context. For systems with 8 GB VRAM, this quant is suitable. If VRAM is limited to 4 GB, consider a lower‑precision quant, but none are provided in the file list.

What GPU do you need for .nemotron-speech-streaming-en-0.6b.q8_0.gguf?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is Q8_0 (0.7 GB file, about 1.3 GB in use).

Which .nemotron-speech-streaming-en-0.6b.q8_0.gguf quant should you choose?

Q8_0 (0.7 GB) is the middle option in this repository. Close to lossless. It costs roughly twice the memory of a 4-bit file, so it suits cases where you have plenty of VRAM.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architectureasr
Parameters628M

Source

Quantized bynvidia
FamilyNemotron
Licenseother
Downloads (HF)106,897
Last updated2026-08-05

Frequently asked questions about .nemotron-speech-streaming-en-0.6b.q8_0.gguf

How much VRAM does .nemotron-speech-streaming-en-0.6b.q8_0.gguf need?

About 1.3 GB at Q8_0 with an 8K context window. That is the 0.7 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run .nemotron-speech-streaming-en-0.6b.q8_0.gguf on an 8 GB GPU?

Yes, with Q8_0: the 0.7 GB file needs about 1.3 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of .nemotron-speech-streaming-en-0.6b.q8_0.gguf GGUF?

It depends on the quant: Q8_0 is 0.7 GB.

Where can I download .nemotron-speech-streaming-en-0.6b.q8_0.gguf GGUF?

The files are on Hugging Face in the nvidia/nemotron-speech-streaming-en-0.6b repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does .nemotron-speech-streaming-en-0.6b.q8_0.gguf use?

Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run Nemotron-ASR-Streaming on 8 GB VRAM?

Yes, the Q8_0 quant requires approximately 1.3 GB of VRAM at 8 k context, well within an 8 GB budget.

Does this model support multiple languages?

No, this checkpoint is English only; multilingual support is available in newer releases.

What chunk sizes can I configure for streaming?

Chunk sizes of 80 ms, 160 ms, 560 ms, and 1120 ms are supported for low‑latency streaming.

Similar models

Browse all →

More from nvidia

All by nvidia →

More Nemotron models

All Nemotron →

Other tiny models

All tiny models →