Joint entity recognition and relation extraction as a multi-head selection problem
arXiv:1804.07847 · doi:10.1016/j.eswa.2018.07.032
Abstract
State-of-the-art models for joint entity recognition and relation extraction strongly rely on external natural language processing (NLP) tools such as POS (part-of-speech) taggers and dependency parsers. Thus, the performance of such joint models depends on the quality of the features obtained from these NLP tools. However, these features are not always accurate for various languages and contexts. In this paper, we propose a joint neural model which performs entity recognition and relation extraction simultaneously, without the need of any manually extracted features or the use of any external tool. Specifically, we model the entity recognition task using a CRF (Conditional Random Fields) layer and the relation extraction task as a multi-head selection problem (i.e., potentially identify multiple relations for each entity). We present an extensive experimental setup, to demonstrate the effectiveness of our method using datasets from various contexts (i.e., news, biomedical, real estate) and languages (i.e., English, Dutch). Our model outperforms the previous neural models that use automatically extracted features, while it performs within a reasonable margin of feature-based neural models, or even beats them.
Expert Systems with Applications, code is available at https://github.com/bekou/multihead_joint_entity_relation_extraction
References in corpus (6)
- Sequence to Sequence Learning with Neural Networks
- Natural Language Processing (almost) from Scratch
- On the difficulty of training Recurrent Neural Networks
- Classifying Relations by Ranking with Convolutional Neural Networks
- An attentive neural architecture for joint segmentation and parsing and its application to real estate ads
- Semantic Relation Classification via Convolutional Neural Networks with Simple Negative Sampling
Cited by in corpus (38)
- Span-based Joint Entity and Relation Extraction with Transformer Pre-training
- End-to-end neural relation extraction using deep biaffine attention
- Deep Neural Approaches to Relation Triplets Extraction: A Comprehensive Survey
- LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding
- Neural Metric Learning for Fast End-to-End Relation Extraction
- End-to-end Named Entity Recognition and Relation Extraction using Pre-trained Language Models
- MatSciRE: Leveraging Pointer Networks to Automate Entity and Relation Extraction for Material Science Knowledge-base Construction
- Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learning
- PRGC: Potential Relation and Global Correspondence Based Joint Relational Triple Extraction
- Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders
- Building Chinese Biomedical Language Models via Multi-Level Text Discrimination
- Jointly Extracting Interventions, Outcomes, and Findings from RCT Reports with LLMs
- Understanding Clinical Trial Reports: Extracting Medical Entities and Their Relations
- Integrating Deep Learning with Logic Fusion for Information Extraction
- An Information Extraction Study: Take In Mind the Tokenization!
- Sub-event detection from Twitter streams as a sequence labeling problem
- A Multi-task Learning Framework for Opinion Triplet Extraction
- Deeper Task-Specificity Improves Joint Entity and Relation Extraction
- Predefined Sparseness in Recurrent Sequence Models
- Deep Neural Networks for Relation Extraction
- Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inference
- AgentRE: An Agent-Based Framework for Navigating Complex Information Landscapes in Relation Extraction
- Bridging Text and Knowledge with Multi-Prototype Embedding for Few-Shot Relational Triple Extraction
- Named Entities in Medical Case Reports: Corpus and Experiments
- Boosting Span-based Joint Entity and Relation Extraction via Squence Tagging Mechanism
- A Trigger-Sense Memory Flow Framework for Joint Entity and Relation Extraction
- RTE: A Tool for Annotating Relation Triplets from Text
- Jointly Learning Clinical Entities and Relations with Contextual Language Models and Explicit Context
- TIJERE: A Novel Threat Intelligence Joint Extraction Model Based on Analyst Expert Knowledge
- TDRE: A Tensor Decomposition Based Approach for Relation Extraction
- Leveraging Unlabeled Data for Entity-Relation Extraction through Probabilistic Constraint Satisfaction
- Semantic Loss Application to Entity Relation Recognition
- Defx at SemEval-2020 Task 6: Joint Extraction of Concepts and Relations for Definition Extraction
- Adjacency List Oriented Relational Fact Extraction via Adaptive Multi-task Learning
- A Conditional Cascade Model for Relational Triple Extraction
- A Novel Global Feature-Oriented Relational Triple Extraction Model based on Table Filling
- Joint Extraction of Entity and Relation with Information Redundancy Elimination
- End to End Chinese Lexical Fusion Recognition with Sememe Knowledge