Multilingual Translation via Grafting Pre-trained Language Models

Zewei Sun, Mingxuan Wang, Lei Li

Can pre-trained BERT for one language and GPT for another be glued together to translate texts? Self-supervised training using only monolingual data has led to the success of pre-t…