A Survey of Orthographic Information in Machine Translation

Abstract

Machine translation is one of the applications of natural language processing which has been explored in different languages. Recently researchers started paying attention towards machine translation for resource-poor languages and closely related languages. A widespread and underlying problem for these machine translation systems is the variation in orthographic conventions which causes many issues to traditional approaches. Two languages written in two different orthographies are not easily comparable, but orthographic information can also be used to improve the machine translation system. This article offers a survey of research regarding orthography's influence on machine translation of under-resourced languages. It introduces under-resourced languages in terms of machine translation and how orthographic information can be utilised to improve machine translation. We describe previous work in this area, discussing what underlying assumptions were made, and showing how orthographic knowledge improves the performance of machine translation of under-resourced languages. We discuss different types of machine translation and demonstrate a recent trend that seeks to link orthographic information with well-established machine translation methods. Considerable attention is given to current efforts of cognates information at different levels of machine translation and the lessons that can be drawn from this. Additionally, multilingual neural machine translation of closely related languages is given a particular focus in this survey. This article ends with a discussion of the way forward in machine translation with orthographic information, focusing on multilingual settings and bilingual lexicon induction.

arXiv comment18 pages

References in corpus (12)

• Sequence to Sequence Learning with Neural Networks
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
• Character-Aware Neural Language Models
• Unsupervised Statistical Machine Translation
• Toward Multilingual Neural Machine Translation with Universal Encoder and Decoder
• Data Augmentation for Low-Resource Neural Machine Translation
• Bilingual Lexicon Induction through Unsupervised Machine Translation
• Improving Neural Machine Translation Robustness via Data Augmentation: Beyond Back Translation
• A Call for Prudent Choice of Subword Merge Operations in Neural Machine Translation
• The Impact of Preprocessing on Arabic-English Statistical and Neural Machine Translation
• Machine Translation of Low-Resource Spoken Dialects: Strategies for Normalizing Swiss German
• Utilizing Lexical Similarity between Related, Low-resource Languages for Pivot-based SMT

Cited by in corpus (5)

• From Plenipotentiary to Puddingless: Users and Uses of New Words in Early English Letters
• CUSATNLP@HASOC-Dravidian-CodeMix-FIRE2020:Identifying Offensive Language from ManglishTweets
• NUIG-Shubhanker@Dravidian-CodeMix-FIRE2020: Sentiment Analysis of Code-Mixed Dravidian text using XLNet
• Theedhum Nandrum@Dravidian-CodeMix-FIRE2020: A Sentiment Polarity Classifier for YouTube Comments with Code-switching between Tamil, Malayalam and English
• Attentive fine-tuning of Transformers for Translation of low-resourced languages @LoResMT 2021