activity
20192023
most citedClosing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing

161 citations · 368 across the 6 of their papers we have counts for

collaborators

7 papers

cs.CY2023★ 3 cited

Evaluating the Social Impact of Generative AI Systems in Systems and Society

Irene Solaiman, Zeerak Talat, William Agnew +28

Generative AI systems across modalities, ranging from text (including code), image, audio, and video, have broad social impacts, but there is no official standard for means of eval…

cs.AI2022★ 33 cited

A Human Rights-Based Approach to Responsible AI

Vinodkumar Prabhakaran, Margaret Mitchell, Timnit Gebru +1

Research on fairness, accountability, transparency and ethics of AI-based interventions in society has gained much-needed momentum in recent years. However it lacks an explicit ali…

cs.CY2022★ 44 cited

Data Governance in the Age of Large-Scale Data-Driven Language Technology

Yacine Jernite, Huu Nguyen, Stella Biderman +18

The recent emergence and adoption of Machine Learning technology, and specifically of Large Language Models, has drawn attention to the need for systematic and transparent manageme…

cs.AI2020★ 66 cited

Diversity and Inclusion Metrics in Subset Selection

Margaret Mitchell, Dylan Baker, Nyalleng Moorosi +5

The ethical concept of fairness has recently been applied in machine learning (ML) settings to describe a wide range of constraints and objectives. When considering the relevance o…

cs.CY2020★ 161 cited

Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing

Inioluwa Deborah Raji, Andrew Smart, Rebecca N. White +6

Rising concern for the societal implications of artificial intelligence systems has inspired a wave of academic and journalistic literature in which deployed systems are audited fo…

cs.CY2020★ 61 cited

Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing

Inioluwa Deborah Raji, Timnit Gebru, Margaret Mitchell +3

Although essential to revealing biased performance, well intentioned attempts at algorithmic auditing can have effects that may harm the very populations these measures are meant t…

cs.CL2019

Perturbation Sensitivity Analysis to Detect Unintended Model Biases

Vinodkumar Prabhakaran, Ben Hutchinson, Margaret Mitchell

Data-driven statistical Natural Language Processing (NLP) techniques leverage large amounts of language data to build models that can understand language. However, most language da…