Answering questions by learning to rank -- Learning to rank by answering questions
arXiv:1909.00596
Abstract
Answering multiple-choice questions in a setting in which no supporting documents are explicitly provided continues to stand as a core problem in natural language processing. The contribution of this article is two-fold. First, it describes a method which can be used to semantically rank documents extracted from Wikipedia or similar natural language corpora. Second, we propose a model employing the semantic ranking that holds the first place in two of the most popular leaderboards for answering multiple-choice questions: ARC Easy and Challenge. To achieve this, we introduce a self-attention based neural network that latently learns to rank documents by their importance related to a given question, whilst optimizing the objective of predicting the correct answer. These documents are considered relevant contexts for the underlying question. We have published the ranked documents so that they can be used off-the-shelf to improve downstream decision models.
arXiv commentPresented at EMNLP 2019; 10 pages, 5 figures
References in corpus (8)
- Adam: A Method for Stochastic Optimization
- Distributed Representations of Sentences and Documents
- SQuAD: 100,000+ Questions for Machine Comprehension of Text
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- RACE: Large-scale ReAding Comprehension Dataset From Examinations
- Reading Wikipedia to Answer Open-Domain Questions
- Improving Question Answering with External Knowledge
- KG^2: Learning to Reason Science Exam Questions with Contextual Knowledge Graph Embeddings