Unsupervised pre-training for sequence to sequence speech recognition

Zhiyun Fan, Shiyu Zhou, Bo Xu

This paper proposes a novel approach to pre-train encoder-decoder sequence-to-sequence (seq2seq) model with unpaired speech and transcripts respectively. Our pre-training method is…