Knowledge-guided Open Attribute Value Extraction with Reinforcement Learning

Abstract

Open attribute value extraction for emerging entities is an important but challenging task. A lot of previous works formulate the problem as a \textit{question-answering} (QA) task. While the collections of articles from web corpus provide updated information about the emerging entities, the retrieved texts can be noisy, irrelevant, thus leading to inaccurate answers. Effectively filtering out noisy articles as well as bad answers is the key to improving extraction accuracy. Knowledge graph (KG), which contains rich, well organized information about entities, provides a good resource to address the challenge. In this work, we propose a knowledge-guided reinforcement learning (RL) framework for open attribute value extraction. Informed by relevant knowledge in KG, we trained a deep Q-network to sequentially compare extracted answers to improve extraction accuracy. The proposed framework is applicable to different information extraction system. Our experimental results show that our method outperforms the baselines by 16.5 - 27.8\%.

arXiv commentEMNLP 2020

References in corpus (11)

• Bidirectional Attention Flow for Machine Comprehension
• A Deep Reinforced Model for Abstractive Summarization
• QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension
• Deep Reinforcement Learning for Dialogue Generation
• RLlib: Abstractions for Distributed Reinforcement Learning
• A Deep Reinforcement Learning Chatbot
• DCN+: Mixed Objective and Deep Residual Coattention for Question Answering
• Dataset and Neural Recurrent Sequence Labeling Model for Open-Domain Factoid Question Answering
• Actor-Critic based Training Framework for Abstractive Summarization
• Stochastic Answer Networks for Machine Reading Comprehension
• Improving Information Extraction by Acquiring External Evidence with Reinforcement Learning