Multi-task Recurrent Model for True Multilingual Speech Recognition
arXiv:1609.08337
Abstract
Research on multilingual speech recognition remains attractive yet challenging. Recent studies focus on learning shared structures under the multi-task paradigm, in particular a feature sharing structure. This approach has been found effective to improve performance on each individual language. However, this approach is only useful when the deployed system supports just one language. In a true multilingual scenario where multiple languages are allowed, performance will be significantly reduced due to the competition among languages in the decoding space. This paper presents a multi-task recurrent model that involves a multilingual speech recognition (ASR) component and a language recognition (LR) component, and the ASR component is informed of the language information by the LR component, leading to a language-aware recognition. We tested the approach on an English-Chinese bilingual recognition task. The results show that the proposed multi-task recurrent model can improve performance of multilingual recognition systems.
APSIPA 2016. arXiv admin note: text overlap with arXiv:1603.09643
References in corpus (4)
- Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
- Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition
- Parallel training of DNNs with Natural Gradient and Parameter Averaging
- Multi-task Recurrent Model for Speech and Speaker Recognition