activity
20192023
most citedClosing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing

161 citations · 368 across the 6 of their papers we have counts for

collaborators

7 papers

cs.CY2023★ 3 cited

Evaluating the Social Impact of Generative AI Systems in Systems and Society

Irene Solaiman, Zeerak Talat, William Agnew +28

Generative AI systems across modalities, ranging from text (including code), image, audio, and video, have broad social impacts, but there is no official standard for means of eval…

cs.AI2022★ 33 cited

A Human Rights-Based Approach to Responsible AI

Vinodkumar Prabhakaran, Margaret Mitchell, Timnit Gebru +1

Research on fairness, accountability, transparency and ethics of AI-based interventions in society has gained much-needed momentum in recent years. However it lacks an explicit ali…

cs.CY2022★ 44 cited

Data Governance in the Age of Large-Scale Data-Driven Language Technology

Yacine Jernite, Huu Nguyen, Stella Biderman +18

The recent emergence and adoption of Machine Learning technology, and specifically of Large Language Models, has drawn attention to the need for systematic and transparent manageme…

cs.AI2020★ 66 cited

Diversity and Inclusion Metrics in Subset Selection

Margaret Mitchell, Dylan Baker, Nyalleng Moorosi +5

The ethical concept of fairness has recently been applied in machine learning (ML) settings to describe a wide range of constraints and objectives. When considering the relevance o…

cs.CY2020★ 161 cited

Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing

Inioluwa Deborah Raji, Andrew Smart, Rebecca N. White +6

Rising concern for the societal implications of artificial intelligence systems has inspired a wave of academic and journalistic literature in which deployed systems are audited fo…

cs.CY2020★ 61 cited

Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing

Inioluwa Deborah Raji, Timnit Gebru, Margaret Mitchell +3

Although essential to revealing biased performance, well intentioned attempts at algorithmic auditing can have effects that may harm the very populations these measures are meant t…