Improving non-autoregressive end-to-end speech recognition with pre-trained acoustic and language models

Keqi Deng, Zehui Yang, Shinji Watanabe +3

While Transformers have achieved promising results in end-to-end (E2E) automatic speech recognition (ASR), their autoregressive (AR) structure becomes a bottleneck for speeding up…