A Survey on Deep Learning for Named Entity Recognition
arXiv:1812.09449 · doi:10.1109/TKDE.2020.2981314
Abstract
Named entity recognition (NER) is the task to identify mentions of rigid designators from text belonging to predefined semantic types such as person, location, organization etc. NER always serves as the foundation for many natural language applications such as question answering, text summarization, and machine translation. Early NER systems got a huge success in achieving good performance with the cost of human engineering in designing domain-specific features and rules. In recent years, deep learning, empowered by continuous real-valued vector representations and semantic composition through nonlinear processing, has been employed in NER systems, yielding stat-of-the-art performance. In this paper, we provide a comprehensive review on existing deep learning techniques for NER. We first introduce NER resources, including tagged NER corpora and off-the-shelf NER tools. Then, we systematically categorize existing works based on a taxonomy along three axes: distributed representations for input, context encoder, and tag decoder. Next, we survey the most representative methods for recent applied techniques of deep learning in new NER problem settings and applications. Finally, we present readers with the challenges faced by NER systems and outline future directions in this area.
20 pages, 12 figures, 3 tables
References in corpus (9)
- A Survey on Recent Advances in Named Entity Recognition from Deep Learning models
- Design Challenges and Misconceptions in Neural Sequence Labeling
- A Multi-task Approach for Named Entity Recognition in Social Media Data
- Online Learning: A Comprehensive Survey
- Hierarchically-Refined Label Attention Network for Sequence Labeling
- Multi-Grained Named Entity Recognition
- Transfer Learning for Named-Entity Recognition with Neural Networks
- End-to-end Recurrent Neural Network Models for Vietnamese Named Entity Recognition: Word-level vs. Character-level
- Neural Disease Named Entity Extraction with Character-based BiLSTM+CRF in Japanese Medical Text
Cited by in corpus (71)
- Medical Deep Learning -- A systematic Meta-Review
- Sentiment analysis and opinion mining on educational data: A survey
- Natural Language Processing Advancements By Deep Learning: A Survey
- Geo-knowledge-guided GPT models improve the extraction of location descriptions from disaster-related social media messages
- Named Entity Recognition and Classification on Historical Documents: A Survey
- Neural Entity Linking: A Survey of Models Based on Deep Learning
- Machine Knowledge: Creation and Curation of Comprehensive Knowledge Bases
- Zero-shot information extraction from radiological reports using ChatGPT
- Construction of Knowledge Graphs: State and Challenges
- AliMe KG: Domain Knowledge Graph Construction and Application in E-commerce
- Probabilistic Semantic Communication over Wireless Networks with Rate Splitting
- TBCOV: Two Billion Multilingual COVID-19 Tweets with Sentiment, Entity, Geo, and Gender Labels
- DP-Forward: Fine-tuning and Inference on Language Models with Differential Privacy in Forward Pass
- A Joint Communication and Computation Design for Probabilistic Semantic Communications
- Zero-shot cross-lingual transfer language selection using linguistic similarity
- LogPrécis: Unleashing Language Models for Automated Malicious Log Analysis
- KisanQRS: A Deep Learning-based Automated Query-Response System for Agricultural Decision-Making
- Training-free Lexical Backdoor Attacks on Language Models
- E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generation
- A Joint Communication and Computation Design for Semantic Wireless Communication with Probability Graph
- Recent Advances in Named Entity Recognition: A Comprehensive Survey and Comparative Study
- From Zero to Hero: Harnessing Transformers for Biomedical Named Entity Recognition in Zero- and Few-shot Contexts
- Healthcare NER Models Using Language Model Pretraining
- Named entity recognition architecture combining contextual and global features
- ContractTinker: LLM-Empowered Vulnerability Repair for Real-World Smart Contracts
- Review of Natural Language Processing in Pharmacology
- Cross-Domain Contract Element Extraction with a Bi-directional Feedback Clause-Element Relation Network
- Beyond Rule-based Named Entity Recognition and Relation Extraction for Process Model Generation from Natural Language Text
- XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages
- Entity Linking Meets Deep Learning: Techniques and Solutions
- Split-NER: Named Entity Recognition via Two Question-Answering-based Classifications
- Enhancing Low Resource NER Using Assisting Language And Transfer Learning
- Evaluating Named Entity Recognition: A comparative analysis of mono- and multilingual transformer models on a novel Brazilian corporate earnings call transcripts dataset
- Literature review on vulnerability detection using NLP technology
- DeepPatent2: A Large-Scale Benchmarking Corpus for Technical Drawing Understanding
- Uncovering Gradient Inversion Risks in Practical Language Model Training
- Pipeline and Dataset Generation for Automated Fact-checking in Almost Any Language
- DAGA: Data Augmentation with a Generation Approach for Low-resource Tagging Tasks
- Deep Learning based Key Information Extraction from Business Documents: Systematic Literature Review
- On Significance of Subword tokenization for Low Resource and Efficient Named Entity Recognition: A case study in Marathi
- Extracting Domain-specific Concepts from Large-scale Linked Open Data
- MAWSEO: Adversarial Wiki Search Poisoning for Illicit Online Promotion
- Learning Relation Prototype from Unlabeled Texts for Long-tail Relation Extraction
- CS-lol: a Dataset of Viewer Comment with Scene in E-sports Live-streaming
- Beep: Fine-grained Fix Localization by Learning to Predict Buggy Code Elements
- An End-to-End Solution for Named Entity Recognition in eCommerce Search
- Dutch Named Entity Recognition and De-identification Methods for the Human Resource Domain
- Patent-KG: Patent Knowledge Graph Use for Engineering Design
- Visual Analysis of LLM-based Entity Resolution from Scientific Papers
- Dynamic Named Entity Recognition
- Adaptive Ordered Information Extraction with Deep Reinforcement Learning
- An Experimental Study on Data Augmentation Techniques for Named Entity Recognition on Low-Resource Domains
- HAMNER: Headword Amplified Multi-span Distantly Supervised Method for Domain Specific Named Entity Recognition
- TinyGenius: Intertwining Natural Language Processing with Microtask Crowdsourcing for Scholarly Knowledge Graph Creation
- NLP for Climate Policy: Creating a Knowledge Platform for Holistic and Effective Climate Action
- AT-BERT: Adversarial Training BERT for Acronym Identification Winning Solution for SDU@AAAI-21
- STAMP 4 NLP -- An Agile Framework for Rapid Quality-Driven NLP Applications Development
- A New Multifractal-based Deep Learning Model for Text Mining
- Similarity-based Memory Enhanced Joint Entity and Relation Extraction
- Improving NER's Performance with Massive financial corpus
- Deep Learning -- A first Meta-Survey of selected Reviews across Scientific Disciplines, their Commonalities, Challenges and Research Impact
- Benchmarking Modern Named Entity Recognition Techniques for Free-text Health Record De-identification
- Incorporating Uncertain Segmentation Information into Chinese NER for Social Media Text
- A Light-weight contextual spelling correction model for customizing transducer-based speech recognition systems
- Recognising Biomedical Names: Challenges and Solutions
- Where Did the President Visit Last Week? Detecting Celebrity Trips from News Articles
- Domain-Transferable Method for Named Entity Recognition Task
- Named Entity Recognition -- Is there a glass ceiling?
- Joint Extraction of Entity and Relation with Information Redundancy Elimination
- Understood in Translation, Transformers for Domain Understanding
- Fine Tuning Named Entity Extraction Models for the Fantasy Domain