Robust Multilingual Named Entity Recognition with Shallow Semi-Supervised Features

Abstract

We present a multilingual Named Entity Recognition approach based on a robust and general set of features across languages and datasets. Our system combines shallow local information with clustering semi-supervised features induced on large amounts of unlabeled text. Understanding via empirical experimentation how to effectively combine various types of clustering features allows us to seamlessly export our system to other datasets and languages. The result is a simple but highly competitive system which obtains state of the art results across five languages and twelve datasets. The results are reported on standard shared task evaluation data such as CoNLL for English, Spanish and Dutch. Furthermore, and despite the lack of linguistically motivated features, we also report best results for languages such as Basque and German. In addition, we demonstrate that our method also obtains very competitive results even when the amount of supervised data is cut by half, alleviating the dependency on manually annotated data. Finally, the results show that our emphasis on clustering features is crucial to develop robust out-of-domain models. The system and models are freely available to facilitate its use and guarantee the reproducibility of results.

26 pages, 19 tables (submitted for publication on September 2015), Artificial Intelligence (2016)

References in corpus (2)

• Distributed Representations of Words and Phrases and their Compositionality
• Introduction to the CoNLL-2002 Shared Task: Language-Independent Named Entity Recognition

Cited by in corpus (11)

• A Survey on Recent Advances in Named Entity Recognition from Deep Learning models
• Language Independent Sequence Labelling for Opinion Target Extraction
• From Zero to Hero: Harnessing Transformers for Biomedical Named Entity Recognition in Zero- and Few-shot Contexts
• Sequence Labeling: A Practical Approach
• Give your Text Representation Models some Love: the Case for Basque
• DomainNet: Homograph Detection for Data Lake Disambiguation
• Social Analysis of Young Basque Speaking Communities in Twitter
• Sentiment Tagging with Partial Labels using Modular Architectures
• Question-Aware Sentence Gating Networks for Question and Answering
• microNER: A Micro-Service for German Named Entity Recognition based on BiLSTM-CRF
• Multilingual and Cross-lingual Timeline Extraction