Improving Information Extraction by Acquiring External Evidence with Reinforcement Learning

Abstract

Most successful information extraction systems operate with access to a large collection of documents. In this work, we explore the task of acquiring and incorporating external evidence to improve extraction accuracy in domains where the amount of training data is scarce. This process entails issuing search queries, extraction from new sources and reconciliation of extracted values, which are repeated until sufficient evidence is collected. We approach the problem using a reinforcement learning framework where our model learns to select optimal actions based on contextual information. We employ a deep Q-network, trained to optimize a reward function that reflects extraction accuracy while penalizing extra effort. Our experiments on two databases -- of shooting incidents, and food adulteration cases -- demonstrate that our system significantly outperforms traditional extractors and a competitive meta-classifier baseline.

Appearing in EMNLP 2016 (12 pages incl. supplementary material)

References in corpus (1)

• Compositional Vector Space Models for Knowledge Base Completion

Cited by in corpus (23)

• Deep Reinforcement Learning: An Overview
• R${}^3$: Reinforced Reader-Ranker for Open-Domain Question Answering
• Out of the Box: Reasoning with Graph Convolution Nets for Factual Visual Question Answering
• Dynamic Integration of Background Knowledge in Neural NLU Systems
• Learning how to Active Learn: A Deep Reinforcement Learning Approach
• FVQA: Fact-based Visual Question Answering
• Task-Oriented Query Reformulation with Reinforcement Learning
• A Hierarchical Framework for Relation Extraction with Reinforcement Learning
• Event Extraction with Generative Adversarial Imitation Learning
• Deep Reinforcement Learning for Chinese Zero pronoun Resolution
• Sentence Simplification with Deep Reinforcement Learning
• Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
• Hierarchical Question Answering for Long Documents
• NLPGym -- A toolkit for evaluating RL agents on Natural Language Processing Tasks
• Improving Neural Relation Extraction with Positive and Unlabeled Learning
• Policy Shaping and Generalized Update Equations for Semantic Parsing from Denotations
• Learning Dynamic Context Augmentation for Global Entity Linking
• Learning Representations and Agents for Information Retrieval
• Improving Search through A3C Reinforcement Learning based Conversational Agent
• Knowledge-guided Open Attribute Value Extraction with Reinforcement Learning
• Knowledge Completion for Generics using Guided Tensor Factorization
• Indirect Supervision for Relation Extraction using Question-Answer Pairs
• A Coarse to Fine Question Answering System based on Reinforcement Learning