Automated Hate Speech Detection and the Problem of Offensive Language
arXiv:1703.04009
Abstract
A key challenge for automatic hate-speech detection on social media is the separation of hate speech from other instances of offensive language. Lexical detection methods tend to have low precision because they classify all messages containing particular terms as hate speech and previous work using supervised learning has failed to distinguish between the two categories. We used a crowd-sourced hate speech lexicon to collect tweets containing hate speech keywords. We use crowd-sourcing to label a sample of these tweets into three categories: those containing hate speech, only offensive language, and those with neither. We train a multi-class classifier to distinguish between these different categories. Close analysis of the predictions and the errors shows when we can reliably separate hate speech from other offensive language and when this differentiation is more difficult. We find that racist and homophobic tweets are more likely to be classified as hate speech but that sexist tweets are generally classified as offensive. Tweets without explicit hate keywords are also more difficult to classify.
arXiv commentTo appear in the Proceedings of ICWSM 2017. Please cite that version
References in corpus (2)
Cited by in corpus (62)
- Detecting Offensive Language in Tweets Using Deep Learning
- Stereotypical Bias Removal for Hate Speech Detection Task using Knowledge-based Generalizations
- The Structure of Toxic Conversations on Twitter
- Explainable AI: current status and future directions
- An Online Multilingual Hate speech Recognition System
- Hate Speech Detection from Code-mixed Hindi-English Tweets Using Deep Learning Models
- Conversations Gone Awry: Detecting Early Signs of Conversational Failure
- Modeling Islamist Extremist Communications on Social Media using Contextual Dimensions: Religion, Ideology, and Hate
- Towards countering hate speech against journalists on social media
- Hate Speech Detection: A Solved Problem? The Challenging Case of Long Tail on Twitter
- Detecting Hate Speech in Multi-modal Memes
- Hateminers : Detecting Hate speech against Women
- "Like Sheep Among Wolves": Characterizing Hateful Users on Twitter
- Retweet communities reveal the main sources of hate speech
- Detecting Hate Speech in Social Media
- Trajectories of Blocked Community Members: Redemption, Recidivism and Departure
- Degree based Classification of Harmful Speech using Twitter Data
- Forecasting the presence and intensity of hostility on Instagram using linguistic and social features
- Interpretable Multi-Modal Hate Speech Detection
- Misogynistic Tweet Detection: Modelling CNN with Small Datasets
- Monitoring Targeted Hate in Online Environments
- Towards non-toxic landscapes: Automatic toxic comment detection using DNN
- Towards generalisable hate speech detection: a review on obstacles and solutions
- Offensive Language and Hate Speech Detection with Deep Learning and Transfer Learning
- A large-scale crowdsourced analysis of abuse against women journalists and politicians on Twitter
- Empirical Analysis of Multi-Task Learning for Reducing Model Bias in Toxic Comment Detection
- Hostility Detection Dataset in Hindi
- Addressing machine learning concept drift reveals declining vaccine sentiment during the COVID-19 pandemic
- SWE2: SubWord Enriched and Significant Word Emphasized Framework for Hate Speech Detection
- Understanding and Detecting Dangerous Speech in Social Media
- Designing Toxic Content Classification for a Diversity of Perspectives
- Predicting Different Types of Subtle Toxicity in Unhealthy Online Conversations
- Rating for Parents: Predicting Children Suitability Rating for Movies Based on Language of the Movies
- On the Social and Technical Challenges of Web Search Autosuggestion Moderation
- Walk in Wild: An Ensemble Approach for Hostility Detection in Hindi Posts
- The Enemy Among Us: Detecting Hate Speech with Threats Based 'Othering' Language Embeddings
- Lifelong Learning of Hate Speech Classification on Social Media
- Fine-tuning of Pre-trained Transformers for Hate, Offensive, and Profane Content Detection in English and Marathi
- Detecting Offensive Content in Open-domain Conversations using Two Stage Semi-supervision
- HASOCOne@FIRE-HASOC2020: Using BERT and Multilingual BERT models for Hate Speech Detection
- Learning from Fact-checkers: Analysis and Generation of Fact-checking Language
- Hierarchical CVAE for Fine-Grained Hate Speech Classification
- How Hateful are Movies? A Study and Prediction on Movie Subtitles
- Low-Shot Classification: A Comparison of Classical and Deep Transfer Machine Learning Approaches
- Reading Between the Demographic Lines: Resolving Sources of Bias in Toxicity Classifiers
- A survey on extremism analysis using Natural Language Processing
- Effect of Word Embedding Models on Hate and Offensive Speech Detection
- Tackling Racial Bias in Automated Online Hate Detection: Towards Fair and Accurate Classification of Hateful Online Users Using Geometric Deep Learning
- Detecting Hostile Posts using Relational Graph Convolutional Network
- Detecting Inappropriate Messages on Sensitive Topics that Could Harm a Company's Reputation
- IIITG-ADBU@HASOC-Dravidian-CodeMix-FIRE2020: Offensive Content Detection in Code-Mixed Dravidian Text
- Detection of COVID-19 informative tweets using RoBERTa
- Analysis of the Ethiopic Twitter Dataset for Abusive Speech in Amharic
- Sexism Identification in Tweets and Gabs using Deep Neural Networks
- Analyzing Uncivil Speech Provocation and Implicit Topics in Online Political News
- A Bootstrapped Model to Detect Abuse and Intent in White Supremacist Corpora
- Characterizing Abhorrent, Misinformative, and Mistargeted Content on YouTube
- Statistical Analysis of Perspective Scores on Hate Speech Detection
- Pegasus@Dravidian-CodeMix-HASOC2021: Analyzing Social Media Content for Detection of Offensive Text
- Reducing Unintended Bias of ML Models on Tabular and Textual Data
- Distributionally Robust Removal of Malicious Nodes from Networks
- Anomaly-Injected Deep Support Vector Data Description for Text Outlier Detection