parakeet tdt ctc 110m needs about 0.6 GB of memory at Q8_0 (a 0.1 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 3 quants, from 0.1 GB (Q4_K) to 0.2 GB.
Parakeet TDT+CTC 110M – English ASR with punctuation and capitalization
Parakeet TDT+CTC 110M is a 0.115 billion‑parameter ASR model. It transcribes 16 kHz mono audio with punctuation and mixed‑case output. The model is released under CC‑BY‑4.0 and is available in GGUF format.
Good at
- Fast single‑pass transcription up to 20 min
- High‑throughput batch processing
- Low‑RAM deployment
Limits
- No vision support
- Limited to English only
- Requires 8 k context for memory estimates
Best for
- Batch transcription on edge devices
- Real‑time speech‑to‑text pipelines
- Low‑latency inference with limited VRAM
Who it’s for. Engineers building speech‑to‑text services that need a lightweight, fast model. Researchers testing hybrid TDT+CTC architectures on small hardware.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| Q4_K | 0.1 GB | 0.6 GB | Fits | Get file → | |
| Q8_0 | 0.1 GB | 0.6 GB | Fits | Get file → | |
| — | 0.2 GB | 0.8 GB | Fits | Get file → |
For 8 GB VRAM, use Q4_K (0.08 GB file, ~0.6 GB memory at 8 k context). For 16 GB VRAM, Q8_0 (0.13 GB file, ~0.6 GB memory). The unknown quant uses 0.23 GB file and ~0.8 GB memory.
What GPU do you need for parakeet tdt ctc 110m?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is the main file (0.2 GB file, about 0.8 GB in use).
Which parakeet tdt ctc 110m quant should you choose?
Q8_0 (0.1 GB) is the middle option in this repository. Close to lossless. It costs roughly twice the memory of a 4-bit file, so it suits cases where you have plenty of VRAM.
If memory is tight, the smallest file is Q4_K at 0.1 GB, with the quality trade-offs that come with fewer bits. The usual sweet spot between file size and quality, and the quant most people start with.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about parakeet tdt ctc 110m
How much VRAM does parakeet tdt ctc 110m need?
About 0.6 GB at Q8_0 with an 8K context window. That is the 0.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run parakeet tdt ctc 110m on an 8 GB GPU?
Yes, with the smaller files: the 0.2 GB file needs about 0.8 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of parakeet tdt ctc 110m GGUF?
It depends on the quant: Q4_K is 0.1 GB, Q8_0 is 0.1 GB, file is 0.2 GB.
Where can I download parakeet tdt ctc 110m GGUF?
The files are on Hugging Face in the cstr/parakeet-tdt_ctc-110m-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does parakeet tdt ctc 110m use?
Hugging Face lists the license as cc-by-4.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run Parakeet TDT+CTC 110M on 8 GB VRAM?
Yes, the Q4_K quantization requires about 0.6 GB of VRAM at 8 k context, well within 8 GB.
Does this model support languages other than English?
No, the model is trained only on English speech and outputs English text.
What license applies to this model?
The model is licensed under CC‑BY‑4.0, allowing reuse with attribution.