Robust Distant Supervision Relation Extraction via Deep Reinforcement Learning

Abstract

Distant supervision has become the standard method for relation extraction. However, even though it is an efficient method, it does not come at no cost---The resulted distantly-supervised training samples are often very noisy. To combat the noise, most of the recent state-of-the-art approaches focus on selecting one-best sentence or calculating soft attention weights over the set of the sentences of one specific entity pair. However, these methods are suboptimal, and the false positive problem is still a key stumbling bottleneck for the performance. We argue that those incorrectly-labeled candidate sentences must be treated with a hard decision, rather than being dealt with soft attention weights. To do this, our paper describes a radical solution---We explore a deep reinforcement learning strategy to generate the false-positive indicator, where we automatically recognize false positives for each relation type without any supervised information. Unlike the removal operation in the previous studies, we redistribute them into the negative examples. The experimental results show that the proposed strategy significantly improves the performance of distant supervision comparing to state-of-the-art systems.

References in corpus (3)

• Playing Atari with Deep Reinforcement Learning
• Classifying Relations by Ranking with Convolutional Neural Networks
• Learning how to Active Learn: A Deep Reinforcement Learning Approach

Cited by in corpus (13)

• Deep Neural Approaches to Relation Triplets Extraction: A Comprehensive Survey
• A Hierarchical Framework for Relation Extraction with Reinforcement Learning
• Deep Neural Network Based Relation Extraction: An Overview
• CopyMTL: Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learning
• OpenKI: Integrating Open Information Extraction and Knowledge Bases with Relation Inference
• Neural Relation Extraction via Inner-Sentence Noise Reduction and Transfer Learning
• Improving Neural Relation Extraction with Positive and Unlabeled Learning
• RH-Net: Improving Neural Relation Extraction via Reinforcement Learning and Hierarchical Relational Searching
• RDSGAN: Rank-based Distant Supervision Relation Extraction with Generative Adversarial Framework
• Deep Self-Supervised Representation Learning for Free-Hand Sketch
• Reinforcement Learning-based N-ary Cross-Sentence Relation Extraction
• Automatic Severity Classification of Coronary Artery Disease via Recurrent Capsule Network
• SENT: Sentence-level Distant Relation Extraction via Negative Training