Analysis of Named Entity Recognition and Linking for Tweets

Abstract

Applying natural language processing for mining and intelligent information access to tweets (a form of microblog) is a challenging, emerging research area. Unlike carefully authored news text and other longer content, tweets pose a number of new challenges, due to their short, noisy, context-dependent, and dynamic nature. Information extraction from tweets is typically performed in a pipeline, comprising consecutive stages of language identification, tokenisation, part-of-speech tagging, named entity recognition and entity disambiguation (e.g. with respect to DBpedia). In this work, we describe a new Twitter entity disambiguation dataset, and conduct an empirical analysis of named entity recognition and disambiguation, investigating how robust a number of state-of-the-art systems are on such noisy texts, what the main sources of error are, and which problems should be further investigated to improve the state of the art.

arXiv comment35 pages, accepted to journal Information Processing and Management

References in corpus (2)

• Introduction to the CoNLL-2002 Shared Task: Language-Independent Named Entity Recognition
• USFD at KBP 2011: Entity Linking, Slot Filling and Temporal Bounding

Cited by in corpus (24)

• Directions in Abusive Language Training Data: Garbage In, Garbage Out
• A Survey of Location Prediction on Twitter
• Autoregressive Entity Retrieval
• Machine Knowledge: Creation and Curation of Comprehensive Knowledge Bases
• Modeling Noisiness to Recognize Named Entities using Multitask Neural Networks on Social Media
• Implicit Entity Linking in Tweets
• EntQA: Entity Linking as Question Answering
• Location Name Extraction from Targeted Text Streams using Gazetteer-based Statistical Language Models
• Reddit Entity Linking Dataset
• End-to-End Neural Entity Linking
• Crisis talk: analysis of the public debate around the energy crisis and cost of living
• Good Applications for Crummy Entity Linkers? The Case of Corpus Selection in Digital Humanities
• TempEL: Linking Dynamically Evolving and Newly Emerging Entities
• Interpretable Multi-dataset Evaluation for Named Entity Recognition
• Simple Natural Language Processing Tools for Danish
• ReLiC: Entity Profiling by using Random Forest and Trustworthiness of a Source - Technical Report
• Named Entity Recognition on Code-Switched Data: Overview of the CALCS 2018 Shared Task
• Benchmarking Knowledge Graphs on the Web
• Competing Topic Naming Conventions in Quora: Predicting Appropriate Topic Merges and Winning Topics from Millions of Topic Pairs
• Recognizing Musical Entities in User-generated Content
• WikiGUM: Exhaustive Entity Linking for Wikification in 12 Genres
• Evaluating end-to-end entity linking on domain-specific knowledge bases: Learning about ancient technologies from museum collections
• Entities of Interest
• TMR: Evaluating NER Recall on Tough Mentions