Towards Making the Most of Dialogue Characteristics for Neural Chat Translation

Abstract

Neural Chat Translation (NCT) aims to translate conversational text between speakers of different languages. Despite the promising performance of sentence-level and context-aware neural machine translation models, there still remain limitations in current NCT models because the inherent dialogue characteristics of chat, such as dialogue coherence and speaker personality, are neglected. In this paper, we propose to promote the chat translation by introducing the modeling of dialogue characteristics into the NCT model. To this end, we design four auxiliary tasks including monolingual response generation, cross-lingual response generation, next utterance discrimination, and speaker identification. Together with the main chat translation task, we optimize the NCT model through the training objectives of all these tasks. By this means, the NCT model can be enhanced by capturing the inherent dialogue characteristics, thus generating more coherent and speaker-relevant translations. Comprehensive experiments on four language directions (English-German and English-Chinese) verify the effectiveness and superiority of the proposed approach.

arXiv commentAccepted as a long paper at EMNLP 2021 main conference. The first two authors contributed equally. Code: https://github.com/XL2248/CSA-NCT

References in corpus (8)

• Efficient Estimation of Word Representations in Vector Space
• Sequence to Sequence Learning with Neural Networks
• Achieving Human Parity on Automatic Chinese to English News Translation
• THUMT: An Open Source Toolkit for Neural Machine Translation
• Modeling Coherence for Neural Machine Translation with Dynamic and Topic Caches
• Taskmaster-1: Toward a Realistic and Diverse Dialog Dataset
• Findings of the WMT 2024 Shared Task on Chat Translation
• Autocorrect in the Process of Translation -- Multi-task Learning Improves Dialogue Machine Translation