Toward Cross-Lingual Definition Generation for Language Learners

Abstract

Generating dictionary definitions automatically can prove useful for language learners. However, it's still a challenging task of cross-lingual definition generation. In this work, we propose to generate definitions in English for words in various languages. To achieve this, we present a simple yet effective approach based on publicly available pretrained language models. In this approach, models can be directly applied to other languages after trained on the English dataset. We demonstrate the effectiveness of this approach on zero-shot definition generation. Experiments and manual analyses on newly constructed datasets show that our models have a strong cross-lingual transfer ability and can generate fluent English definitions for Chinese words. We further measure the lexical complexity of generated and reference definitions. The results show that the generated definitions are much simpler, which is more suitable for language learners.

References in corpus (5)

• Enriching Word Vectors with Subword Information
• Breaking Sticks and Ambiguities with Adaptive Skip-gram
• Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks
• xSense: Learning Sense-Separated Sparse Representations and Textual Definitions for Explainable Word Sense Networks
• Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsing