Attribute-Based Diagnosis of LLM Alignment with Hate Speech Annotations

Mohammad Amine Jradi, Faeze Ghorbanpour, Alexander Fraser

Hate speech annotation is costly, subjective, and prone to annotator disagreement, making large-scale dataset construction challenging. We systematically analyze how well large lan…