2 citations · 7 across the 19 of their papers we have counts for
4 papers · 1 filter
Disentangling Perceptions of Offensiveness: Cultural and Moral Correlates
Aida Davani, Mark Díaz, Dylan Baker +1
Perception of offensiveness is inherently subjective, shaped by the lived experiences and socio-cultural values of the perceivers. Recent years have seen substantial efforts to bui…
SoUnD Framework: Analyzing (So)cial Representation in (Un)structured (D)ata
Mark Díaz, Sunipa Dev, Emily Reif +2
The unstructured nature of data used in foundation model development is a challenge to systematic analyses for making data use and documentation decisions. From a Responsible AI pe…
A Taxonomy of Rater Disagreements: Surveying Challenges & Opportunities from the Perspective of Annotating Online Toxicity
Wenbo Zhang, Hangzhi Guo, Ian D Kivlichan +3
Toxicity is an increasingly common and severe issue in online spaces. Consequently, a rich line of machine learning research over the past decade has focused on computationally det…
GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives
Vinodkumar Prabhakaran, Christopher Homan, Lora Aroyo +6
Human annotation plays a core role in machine learning -- annotations for supervised models, safety guardrails for generative models, and human feedback for reinforcement learning,…