Controlling Neural Machine Translation Formality with Synthetic Supervision

Abstract

This work aims to produce translations that convey source language content at a formality level that is appropriate for a particular audience. Framing this problem as a neural sequence-to-sequence task ideally requires training triplets consisting of a bilingual sentence pair labeled with target language formality. However, in practice, available training examples are limited to English sentence pairs of different styles, and bilingual parallel sentences of unknown formality. We introduce a novel training scheme for multi-task models that automatically generates synthetic training triplets by inferring the missing element on the fly, thus enabling end-to-end training. Comprehensive automatic and human assessments show that our best model outperforms existing models by producing translations that better match desired formality levels while preserving the source meaning.

arXiv commentAccepted at AAAI 2020

References in corpus (9)

• Effective Approaches to Attention-based Neural Machine Translation
• Layer Normalization
• Sockeye: A Toolkit for Neural Machine Translation
• Toward Controlled Generation of Text
• The Missing Ingredient in Zero-Shot Neural Machine Translation
• Multi-Task Neural Models for Translating Between Styles Within and Across Languages
• Effective Strategies in Zero-Shot Neural Machine Translation
• Contextual Parameter Generation for Universal Neural Machine Translation
• Monolingual and Cross-lingual Zero-shot Style Transfer