AWE: Asymmetric Word Embedding for Textual Entailment
arXiv:1809.04047
Abstract
Textual entailment is a fundamental task in natural language processing. It refers to the directional relation between text fragments such that the "premise" can infer "hypothesis". In recent years deep learning methods have achieved great success in this task. Many of them have considered the inter-sentence word-word interactions between the premise-hypothesis pairs, however, few of them considered the "asymmetry" of these interactions. Different from paraphrase identification or sentence similarity evaluation, textual entailment is essentially determining a directional (asymmetric) relation between the premise and the hypothesis. In this paper, we propose a simple but effective way to enhance existing textual entailment algorithms by using asymmetric word embeddings. Experimental results on SciTail and SNLI datasets show that the learned asymmetric word embeddings could significantly improve the word-word interaction based textual entailment models. It is noteworthy that the proposed AWE-DeIsTe model can get 2.1% accuracy improvement over prior state-of-the-art on SciTail.
References in corpus (11)
- Adam: A Method for Stochastic Optimization
- Enhanced LSTM for Natural Language Inference
- Reasoning about Entailment with Neural Attention
- A large annotated corpus for learning natural language inference
- Neural Natural Language Inference Models Enhanced with External Knowledge
- Learned in Translation: Contextualized Word Vectors
- Natural Language Inference over Interaction Space
- Bilateral Multi-Perspective Matching for Natural Language Sentences
- Learning Natural Language Inference with LSTM
- A Decomposable Attention Model for Natural Language Inference
- Semantic Sentence Matching with Densely-connected Recurrent and Co-attentive Information