Learning Representations and Agents for Information Retrieval
arXiv:1908.06132
Abstract
A goal shared by artificial intelligence and information retrieval is to create an oracle, that is, a machine that can answer our questions, no matter how difficult they are. A more limited, but still instrumental, version of this oracle is a question-answering system, in which an open-ended question is given to the machine, and an answer is produced based on the knowledge it has access to. Such systems already exist and are increasingly capable of answering complicated questions. This progress can be partially attributed to the recent success of machine learning and to the efficient methods for storing and retrieving information, most notably through web search engines. One can imagine that this general-purpose question-answering system can be built as a billion-parameters neural network trained end-to-end with a large number of pairs of questions and answers. We argue, however, that although this approach has been very successful for tasks such as machine translation, storing the world's knowledge as parameters of a learning machine can be very hard. A more efficient way is to train an artificial agent on how to use an external retrieval system to collect relevant information. This agent can leverage the effort that has been put into designing and running efficient storage and retrieval systems by learning how to best utilize them to accomplish a task. ...
References in corpus (13)
- Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
- Bidirectional Attention Flow for Machine Comprehension
- Convolutional Neural Networks for Sentence Classification
- SQuAD: 100,000+ Questions for Machine Comprehension of Text
- A Deep Reinforcement Learning Chatbot
- Evidence Aggregation for Answer Re-Ranking in Open-Domain Question Answering
- Hierarchical Neural Story Generation
- Improving Exploration in Evolution Strategies for Deep Reinforcement Learning via a Population of Novelty-Seeking Agents
- Language Understanding for Text-based Games Using Deep Reinforcement Learning
- R: Reinforced Reader-Ranker for Open-Domain Question Answering
- An Updated Duet Model for Passage Re-ranking
- Improving Information Extraction by Acquiring External Evidence with Reinforcement Learning
- The Divergence of Reinforcement Learning Algorithms with Value-Iteration and Function Approximation