ANEA: Distant Supervision for Low-Resource Named Entity Recognition

Abstract

Distant supervision allows obtaining labeled training corpora for low-resource settings where only limited hand-annotated data exists. However, to be used effectively, the distant supervision must be easy to gather. In this work, we present ANEA, a tool to automatically annotate named entities in texts based on entity lists. It spans the whole pipeline from obtaining the lists to analyzing the errors of the distant supervision. A tuning step allows the user to improve the automatic annotation with their linguistic insights without labelling or checking all tokens manually. In six low-resource scenarios, we show that the F1-score can be increased by on average 18 points through distantly supervised data obtained by ANEA.

arXiv commentAccepted at Practical Machine Learning For Developing Countries @ ICLR 2021

References in corpus (6)

• Snorkel: Rapid Training Data Creation with Weak Supervision
• Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages
• NLNDE: Enhancing Neural Sequence Taggers with Attention and Noisy Channel for Robust Pharmacological Entity Detection
• Massive vs. Curated Word Embeddings for Low-Resourced Languages. The Case of Yorùbá and Twi
• Distant Supervision and Noisy Label Learning for Low Resource Named Entity Recognition: A Study on Hausa and Yorùbá
• A Lightweight Front-end Tool for Interactive Entity Population