Directions in Abusive Language Training Data: Garbage In, Garbage Out

Abstract

Data-driven analysis and detection of abusive online content covers many different tasks, phenomena, contexts, and methodologies. This paper systematically reviews abusive language dataset creation and content in conjunction with an open website for cataloguing abusive language data. This collection of knowledge leads to a synthesis providing evidence-based recommendations for practitioners working with this complex and highly diverse data.

26 pages, 5 figures

References in corpus (10)

• Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
• Analysis of Named Entity Recognition and Linking for Tweets
• Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learning
• Ex Machina: Personal Attacks Seen at Scale
• Language-agnostic BERT Sentence Embedding
• Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles?
• Measuring the Reliability of Hate Speech Annotations: The Case of the European Refugee Crisis
• The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes
• CONAN -- COunter NArratives through Nichesourcing: a Multilingual Dataset of Responses to Fight Online Hate Speech
• Like trainer, like bot? Inheritance of bias in algorithmic content moderation

Cited by in corpus (23)

• Confronting Abusive Language Online: A Survey from the Ethical and Human Rights Perspective
• An Online Multilingual Hate speech Recognition System
• Data and its (dis)contents: A survey of dataset development and use in machine learning research
• Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speech
• Transfer Language Selection for Zero-Shot Cross-Lingual Abusive Language Detection
• HateCheck: Functional Tests for Hate Speech Detection Models
• MultiHateClip: A Multilingual Benchmark Dataset for Hateful Video Detection on YouTube and Bilibili
• Justice in Misinformation Detection Systems: An Analysis of Algorithms, Stakeholders, and Potential Harms
• MetaHate: A Dataset for Unifying Efforts on Hate Speech Detection
• Towards generalisable hate speech detection: a review on obstacles and solutions
• Cross-lingual Capsule Network for Hate Speech Detection in Social Media
• What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpus
• The Unseen Targets of Hate -- A Systematic Review of Hateful Communication Datasets
• The influence of coordinated behavior on toxicity
• Cross-Platform Violence Detection on Social Media: A Dataset and Analysis
• Cross-lingual Offensive Language Detection: A Systematic Review of Datasets, Transfer Approaches and Challenges
• Unified Game Moderation: Soft-Prompting and LLM-Assisted Label Transfer for Resource-Efficient Toxicity Detection
• Focal Inferential Infusion Coupled with Tractable Density Discrimination for Implicit Hate Detection
• An Information Retrieval Approach to Building Datasets for Hate Speech Detection
• Predicting Anti-Asian Hateful Users on Twitter during COVID-19
• Not All Comments are Equal: Insights into Comment Moderation from a Topic-Aware Model
• Detecting Abusive Albanian
• How Does Counterfactually Augmented Data Impact Models for Social Computing Constructs?