omniASR CTC 1B v2 needs about 1.3 GB of memory at Q4_K (a 0.7 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 4 quants, from 0.6 GB (Q4_K) to 2.0 GB.
OmniASR CTC 1B v2 – 0.976B multilingual ASR model in GGUF format
OmniASR CTC 1B v2 is a 0.976B parameter multilingual ASR model converted to GGUF. It outputs CTC logits over a SentencePiece vocabulary and supports over 1600 languages. The model is licensed under Apache‑2.0.
Good at
- Transcribes speech in many languages
- Provides CTC logits for downstream processing
- Supports large vocabularies
Limits
- No vision support
- Requires 8k context for memory estimates
- No mixture of experts
Best for
- Speech transcription pipelines
- ASR research experiments
- Multilingual voice assistants
Who it’s for. Developers building speech recognition systems that need a multilingual model. Researchers exploring CTC‑based ASR architectures may also find this model useful.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| Q4_K | 0.6 GB | 1.1 GB | Fits | Get file → | |
| Q4_K | 0.7 GB | 1.3 GB | Fits | Get file → | |
| Q8_0 | 1.1 GB | 1.7 GB | Fits | Get file → | |
| — | 2.0 GB | 2.7 GB | Fits | Get file → |
For 8 GB VRAM, use the Q4_K quantized file (0.58 GB) which needs about 1.1 GB memory at 8k context. If more VRAM is available, the Q8_0 file (1.06 GB) requires about 1.7 GB memory. The larger unknown quant file (1.95 GB) needs about 2.7 GB memory.
What GPU do you need for omniASR CTC 1B v2?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is the main file (2.0 GB file, about 2.7 GB in use).
Which omniASR CTC 1B v2 quant should you choose?
Q4_K (0.7 GB) is the middle option in this repository. The usual sweet spot between file size and quality, and the quant most people start with.
If memory is tight, the smallest file is Q4_K at 0.6 GB, with the quality trade-offs that come with fewer bits. The usual sweet spot between file size and quality, and the quant most people start with.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about omniASR CTC 1B v2
How much VRAM does omniASR CTC 1B v2 need?
About 1.3 GB at Q4_K with an 8K context window. That is the 0.7 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run omniASR CTC 1B v2 on an 8 GB GPU?
Yes, with the smaller files: the 2.0 GB file needs about 2.7 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of omniASR CTC 1B v2 GGUF?
It depends on the quant: Q4_K is 0.6 GB, Q4_K is 0.7 GB, Q8_0 is 1.1 GB, file is 2.0 GB.
Where can I download omniASR CTC 1B v2 GGUF?
The files are on Hugging Face in the cstr/omniASR-CTC-1B-v2-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does omniASR CTC 1B v2 use?
Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run OmniASR CTC 1B v2 on 8 GB VRAM?
Yes, the Q4_K quantized file (0.58 GB) uses about 1.1 GB memory at 8k context, fitting within 8 GB VRAM.
Does this model support vision tasks?
No, OmniASR CTC 1B v2 is an audio-only ASR model.
What license applies to this GGUF model?
The model is distributed under the Apache‑2.0 license.