An Improved Single Step Non-autoregressive Transformer for Automatic Speech Recognition

Ruchao Fan, Wei Chu, Peng Chang +2

Non-autoregressive mechanisms can significantly decrease inference time for speech transformers, especially when the single step variant is applied. Previous work on CTC alignment-…