Neural Entity Linking: A Survey of Models Based on Deep Learning

Abstract

This survey presents a comprehensive description of recent neural entity linking (EL) systems developed since 2015 as a result of the "deep learning revolution" in natural language processing. Its goal is to systemize design features of neural entity linking systems and compare their performance to the remarkable classic methods on common benchmarks. This work distills a generic architecture of a neural EL system and discusses its components, such as candidate generation, mention-context encoding, and entity ranking, summarizing prominent methods for each of them. The vast variety of modifications of this general architecture are grouped by several common themes: joint entity mention detection and disambiguation, models for global linking, domain-independent techniques including zero-shot and distant supervision methods, and cross-lingual approaches. Since many neural models take advantage of entity and mention/context embeddings to represent their meaning, this work also overviews prominent entity embedding techniques. Finally, the survey touches on applications of entity linking, focusing on the recently emerged use-case of enhancing deep pre-trained masked language models based on the Transformer architecture.

Published in Semantic Web journal

References in corpus (25)

• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Natural Language Processing (almost) from Scratch
• Distributed Representations of Sentences and Documents
• A Survey on Knowledge Graphs: Representation, Acquisition and Applications
• Knowledge Graphs
• Introduction to the CoNLL-2002 Shared Task: Language-Independent Named Entity Recognition
• A Survey on Recent Advances in Named Entity Recognition from Deep Learning models
• Attention Bottlenecks for Multimodal Fusion
• Autoregressive Entity Retrieval
• Generating Knowledge Graphs by Employing Natural Language Processing and Machine Learning Techniques within the Scholarly Domain
• Investigating Entity Knowledge in BERT with Simple Neural End-To-End Entity Linking
• Leveraging Deep Neural Networks and Knowledge Graphs for Entity Disambiguation
• Launching into clinical space with medspaCy: a new clinical text processing toolkit in Python
• On the Computational Efficiency of Training Neural Networks
• Low-Resource Named Entity Recognition with Cross-Lingual, Character-Level Neural Conditional Random Fields
• REL: An Entity Linker Standing on the Shoulders of Giants
• Multimodal Entity Linking for Tweets
• Neural Cross-Lingual Entity Linking
• Improving Entity Linking through Semantic Reinforced Entity Embeddings
• Evaluating the Impact of Knowledge Graph Context on Entity Disambiguation Models
• Zero-shot Entity Linking with Efficient Long Range Sequence Modeling
• End-to-End Entity Linking and Disambiguation leveraging Word and Knowledge Graph Embeddings
• Soft Marginal TransE for Scholarly Knowledge Graph Completion
• Boosting Entity Linking Performance by Leveraging Unlabeled Documents
• Joint Embedding in Named Entity Linking on Sentence Level

Cited by in corpus (13)

• Machine Knowledge: Creation and Curation of Comprehensive Knowledge Bases
• Reddit Entity Linking Dataset
• Reveal the Unknown: Out-of-Knowledge-Base Mention Discovery with Entity Linking
• Entity Linking Meets Deep Learning: Techniques and Solutions
• PromptLink: Leveraging Large Language Models for Cross-Source Biomedical Concept Linking
• xMEN: A Modular Toolkit for Cross-Lingual Medical Entity Normalization
• Dynamic Named Entity Recognition
• TempEL: Linking Dynamically Evolving and Newly Emerging Entities
• Musical Heritage Historical Entity Linking
• Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP
• Taec: a Manually annotated text dataset for trait and phenotype extraction and entity linking in wheat breeding literature
• Namesakes: Ambiguously Named Entities from Wikipedia and News
• Bib2Auth: Deep Learning Approach for Author Disambiguation using Bibliographic Data