A Neural Architecture Mimicking Humans End-to-End for Natural Language Inference
arXiv:1611.04741
Abstract
In this work we use the recent advances in representation learning to propose a neural architecture for the problem of natural language inference. Our approach is aligned to mimic how a human does the natural language inference process given two statements. The model uses variants of Long Short Term Memory (LSTM), attention mechanism and composable neural networks, to carry out the task. Each part of our model can be mapped to a clear functionality humans do for carrying out the overall task of natural language inference. The model is end-to-end differentiable enabling training by stochastic gradient descent. On Stanford Natural Language Inference(SNLI) dataset, the proposed model achieves better accuracy numbers than all published models in literature.
arXiv comment8 pages, 2 figures
References in corpus (9)
- Adam: A Method for Stochastic Optimization
- LSTM: A Search Space Odyssey
- Reasoning about Entailment with Neural Attention
- Ask Me Anything: Dynamic Memory Networks for Natural Language Processing
- A large annotated corpus for learning natural language inference
- Long Short-Term Memory-Networks for Machine Reading
- Order-Embeddings of Images and Language
- A Decomposable Attention Model for Natural Language Inference
- A Fast Unified Model for Parsing and Sentence Understanding