CAT: A CTC-CRF based ASR Toolkit Bridging the Hybrid and the End-to-end Approaches towards Data Efficiency and Low Latency
arXiv:2005.13326
Abstract
In this paper, we present a new open source toolkit for speech recognition, named CAT (CTC-CRF based ASR Toolkit). CAT inherits the data-efficiency of the hybrid approach and the simplicity of the E2E approach, providing a full-fledged implementation of CTC-CRFs and complete training and testing scripts for a number of English and Chinese benchmarks. Experiments show CAT obtains state-of-the-art results, which are comparable to the fine-tuned hybrid models in Kaldi but with a much simpler training pipeline. Compared to existing non-modularized E2E models, CAT performs better on limited-scale datasets, demonstrating its data efficiency. Furthermore, we propose a new method called contextualized soft forgetting, which enables CAT to do streaming ASR without accuracy degradation. We hope CAT, especially the CTC-CRF based framework and software, will be of broad interest to the community, and can be further explored and improved.
Accepted into INTERSPEECH 2020. arXiv admin note: text overlap with arXiv:1911.08747
References in corpus (7)
- Sequence Transduction with Recurrent Neural Networks
- End-to-end Continuous Speech Recognition using Attention-based Recurrent NN: First Results
- Wav2Letter: an End-to-End ConvNet-based Speech Recognition System
- Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling
- Exploring Neural Transducers for End-to-End Speech Recognition
- Espresso: A Fast End-to-end Neural Speech Recognition Toolkit
- Independent language modeling architecture for end-to-end ASR