Improving End-to-end Speech Translation by Leveraging Auxiliary Speech and Text Data

Yuhao Zhang, Chen Xu, Bojie Hu +3

We present a method for introducing a text encoder into pre-trained end-to-end speech translation systems. It enhances the ability of adapting one modality (i.e., source-language s…