parakeet ctc 1.1b ja needs about 1.8 GB of memory at Q8_0 (a 1.1 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 3 quants, from 0.7 GB (Q4_K) to 2.1 GB (F16).
Japanese ASR model with 1.1B parameters
Parakeet CTC 1.1B is a Japanese automatic speech recognition model based on FastConformer-CTC. It is quantized for use with llama.cpp and crispasr. The model is released under Apache-2.0.
Good at
- Japanese speech transcription
- FastConformer encoder
- CTC decoding
Limits
- No vision support
- No other languages
- Requires 8‑k context for estimates
Best for
- Transcribing Japanese audio
- Voice‑to‑text pipelines
- Japanese content moderation
Who it’s for. Developers building Japanese ASR applications. Researchers needing a lightweight, open‑source Japanese speech model. Teams integrating ASR into chat or voice assistants for Japanese language.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| Q4_K | 0.7 GB | 1.3 GB | Fits | Get file → | |
| Q8_0 | 1.1 GB | 1.8 GB | Fits | Get file → | |
| F16 | 2.1 GB | 2.9 GB | Fits | Get file → |
For 8 GB VRAM use Q4_K (0.67 GB file, ~1.3 GB memory). Q8_0 (1.14 GB file, ~1.8 GB memory) is a robust choice for general transcription. If you need the closest match to the NeMo pipeline, use F16 (2.13 GB file, ~2.9 GB memory).
What GPU do you need for parakeet ctc 1.1b ja?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is F16 (2.1 GB file, about 2.9 GB in use).
Which parakeet ctc 1.1b ja quant should you choose?
Q8_0 (1.1 GB) is the middle option in this repository. Close to lossless. It costs roughly twice the memory of a 4-bit file, so it suits cases where you have plenty of VRAM.
If memory is tight, the smallest file is Q4_K at 0.7 GB, with the quality trade-offs that come with fewer bits. The usual sweet spot between file size and quality, and the quant most people start with.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about parakeet ctc 1.1b ja
How much VRAM does parakeet ctc 1.1b ja need?
About 1.8 GB at Q8_0 with an 8K context window. That is the 1.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run parakeet ctc 1.1b ja on an 8 GB GPU?
Yes, with F16: the 2.1 GB file needs about 2.9 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of parakeet ctc 1.1b ja GGUF?
It depends on the quant: Q4_K is 0.7 GB, Q8_0 is 1.1 GB, F16 is 2.1 GB.
Where can I download parakeet ctc 1.1b ja GGUF?
The files are on Hugging Face in the cstr/parakeet-ctc-1.1b-ja-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does parakeet ctc 1.1b ja use?
Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run this model on 8 GB VRAM?
Yes, the Q4_K quant uses about 1.3 GB of VRAM at 8 k context, which fits within 8 GB.
Does this model support languages other than Japanese?
No, it is specifically trained for Japanese and may not perform well on other languages.
What license applies to this model?
The model is released under Apache‑2.0, with the NVIDIA base architecture under CC‑BY‑4.0.