Deep Neural Network Based Relation Extraction: An Overview

Abstract

Knowledge is a formal way of understanding the world, providing a human-level cognition and intelligence for the next-generation artificial intelligence (AI). One of the representations of knowledge is semantic relations between entities. An effective way to automatically acquire this important knowledge, called Relation Extraction (RE), a sub-task of information extraction, plays a vital role in Natural Language Processing (NLP). Its purpose is to identify semantic relations between entities from natural language text. To date, there are several studies for RE in previous works, which have documented these techniques based on Deep Neural Networks (DNNs) become a prevailing technique in this research. Especially, the supervised and distant supervision methods based on DNNs are the most popular and reliable solutions for RE. This article 1) introduces some general concepts, and further 2) gives a comprehensive overview of DNNs in RE from two points of view: supervised RE, which attempts to improve the standard RE systems, and distant supervision RE, which adopts DNNs to design sentence encoder and de-noise method. We further 3) cover some novel methods and recent trends as well as discuss possible future research directions for this task.

References in corpus (12)

• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Relation Classification via Recurrent Neural Network
• End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures
• Classifying Relations by Ranking with Convolutional Neural Networks
• Relation Extraction : A Survey
• A Survey of Deep Learning Methods for Relation Extraction
• Robust Distant Supervision Relation Extraction via Deep Reinforcement Learning
• FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluation
• Multi-Level Structured Self-Attentions for Distantly Supervised Relation Extraction
• Attention-Based Capsule Networks with Dynamic Routing for Relation Extraction
• Transfer Learning for Relation Extraction via Relation-Gated Adversarial Learning
• Jointly Extracting Relations with Class Ties via Effective Deep Ranking