PA

parakeet tdt ctc 110m

ParakeetGGUF by cstrUpdated 2026-08-02
Download on Hugging Face
Parameters115M
Context—
Layers—
Architectureparakeet
Smallest quant0.1 GB
Quick answer

parakeet tdt ctc 110m needs about 0.6 GB of memory at Q8_0 (a 0.1 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 3 quants, from 0.1 GB (Q4_K) to 0.2 GB.

Parakeet TDT+CTC 110M – English ASR with punctuation and capitalization

Parakeet TDT+CTC 110M is a 0.115 billion‑parameter ASR model. It transcribes 16 kHz mono audio with punctuation and mixed‑case output. The model is released under CC‑BY‑4.0 and is available in GGUF format.

Good at

  • Fast single‑pass transcription up to 20 min
  • High‑throughput batch processing
  • Low‑RAM deployment

Limits

  • No vision support
  • Limited to English only
  • Requires 8 k context for memory estimates

Best for

  • Batch transcription on edge devices
  • Real‑time speech‑to‑text pipelines
  • Low‑latency inference with limited VRAM

Who it’s for. Engineers building speech‑to‑text services that need a lightweight, fast model. Researchers testing hybrid TDT+CTC architectures on small hardware.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
Q4_K0.1 GB 0.6 GB
Fits Get file →
Q8_00.1 GB 0.6 GB
Fits Get file →
—0.2 GB 0.8 GB
Fits Get file →

For 8 GB VRAM, use Q4_K (0.08 GB file, ~0.6 GB memory at 8 k context). For 16 GB VRAM, Q8_0 (0.13 GB file, ~0.6 GB memory). The unknown quant uses 0.23 GB file and ~0.8 GB memory.

What GPU do you need for parakeet tdt ctc 110m?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is the main file (0.2 GB file, about 0.8 GB in use).

Which parakeet tdt ctc 110m quant should you choose?

Q8_0 (0.1 GB) is the middle option in this repository. Close to lossless. It costs roughly twice the memory of a 4-bit file, so it suits cases where you have plenty of VRAM.

If memory is tight, the smallest file is Q4_K at 0.1 GB, with the quality trade-offs that come with fewer bits. The usual sweet spot between file size and quality, and the quant most people start with.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architectureparakeet
Parameters115M

Source

Quantized bycstr
FamilyParakeet
Licensecc-by-4.0
Downloads (HF)923
Last updated2026-08-02

Frequently asked questions about parakeet tdt ctc 110m

How much VRAM does parakeet tdt ctc 110m need?

About 0.6 GB at Q8_0 with an 8K context window. That is the 0.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run parakeet tdt ctc 110m on an 8 GB GPU?

Yes, with the smaller files: the 0.2 GB file needs about 0.8 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of parakeet tdt ctc 110m GGUF?

It depends on the quant: Q4_K is 0.1 GB, Q8_0 is 0.1 GB, file is 0.2 GB.

Where can I download parakeet tdt ctc 110m GGUF?

The files are on Hugging Face in the cstr/parakeet-tdt_ctc-110m-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does parakeet tdt ctc 110m use?

Hugging Face lists the license as cc-by-4.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run Parakeet TDT+CTC 110M on 8 GB VRAM?

Yes, the Q4_K quantization requires about 0.6 GB of VRAM at 8 k context, well within 8 GB.

Does this model support languages other than English?

No, the model is trained only on English speech and outputs English text.

What license applies to this model?

The model is licensed under CC‑BY‑4.0, allowing reuse with attribution.

Other GGUFs of parakeet-tdt_ctc-110m

Similar models

Browse all →

More from cstr

All by cstr →

More Parakeet models

All Parakeet →

Other tiny models

All tiny models →