WikiReading: A Novel Large-scale Language Understanding Task over Wikipedia

Abstract

We present WikiReading, a large-scale natural language understanding task and publicly-available dataset with 18 million instances. The task is to predict textual values from the structured knowledge base Wikidata by reading the text of the corresponding Wikipedia articles. The task contains a rich variety of challenging classification and extraction sub-tasks, making it well-suited for end-to-end models such as deep neural networks (DNNs). We compare various state-of-the-art DNN-based architectures for document classification, information extraction, and question answering. We find that models supporting a rich answer space, such as word or character sequences, perform best. Our best-performing model, a word-level sequence to sequence model with a mechanism to copy out-of-vocabulary words, obtains an accuracy of 71.8%.

References in corpus (3)

• Neural Machine Translation by Jointly Learning to Align and Translate
• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
• Recurrent Convolutional Neural Networks for Discourse Compositionality

Cited by in corpus (6)

• BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis
• Generating Wikipedia by Summarizing Long Sequences
• Multi-hop Reading Comprehension across Multiple Documents by Reasoning over Heterogeneous Graphs
• Review Conversational Reading Comprehension
• Neural Program Search: Solving Programming Tasks from Description and Examples
• Short-term Electric Load Forecasting Using TensorFlow and Deep Auto-Encoders