Learning to Represent Bilingual Dictionaries

Abstract

Bilingual word embeddings have been widely used to capture the similarity of lexical semantics in different human languages. However, many applications, such as cross-lingual semantic search and question answering, can be largely benefited from the cross-lingual correspondence between sentences and lexicons. To bridge this gap, we propose a neural embedding model that leverages bilingual dictionaries. The proposed model is trained to map the literal word definitions to the cross-lingual target words, for which we explore with different sentence encoding techniques. To enhance the learning process on limited resources, our model adopts several critical learning strategies, including multi-task learning on different bridges of languages, and joint learning of the dictionary model with a bilingual word embedding model. Experimental evaluation focuses on two applications. The results of the cross-lingual reverse dictionary retrieval task show our model's promising ability of comprehending bilingual concepts based on descriptions, and highlight the effectiveness of proposed learning strategies in improving performance. Meanwhile, our model effectively addresses the bilingual paraphrase identification problem and significantly outperforms previous approaches.

arXiv commentCoNLL 2019

References in corpus (16)

• Distributed Representations of Words and Phrases and their Compositionality
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
• On the Convergence of Adam and Beyond
• Exploiting Similarities among Languages for Machine Translation
• Convolutional Neural Network Architectures for Matching Natural Language Sentences
• ConceptNet 5.5: An Open Multilingual Graph of General Knowledge
• Skip-Thought Vectors
• Style Transfer from Non-Parallel Text by Cross-Alignment
• Reasoning about Entailment with Neural Attention
• A Convolutional Neural Network for Modelling Sentences
• An Autoencoder Approach to Learning Bilingual Word Representations
• BilBOWA: Fast Bilingual Distributed Representations without Word Alignments
• How multilingual is Multilingual BERT?
• emoji2vec: Learning Emoji Representations from their Description