19 papers
What We Know about Responsible AI Practices in Industry: A Half Decade of Empirical Research
Wesley Hanwen Deng, Agathe Balayn, Andrew Selbst +6
Responsible AI (RAI) has become a central concern for technology companies, regulators, and the public. How industry practitioners interpret, implement, and sustain RAI work direct…
Beyond "I Can't Help With That": How Child Safety Experts Evaluate AI Chatbot Safety
Hannah Cha, Neha Shukla, Solon Barocas +3
Youth increasingly turn to AI chatbots for social and emotional support, raising concerns about how these systems respond, especially in high-stakes situations. However, existing c…
The Fair Lending Model: How the Longest-Running Algorithmic Fairness Programs Work in Practice
Emily Black, Miranda Bogen, Logan Koepke +3
U.S. financial institutions subject to fair lending laws have been running algorithmic fairness programs for decades. Despite this long history, remarkably little is known about ho…
AI-Assisted Systematization for Evaluating GenAI Systems
Dhruv Agarwal, Emily Sheng, Chad Atalla +6
Evaluating generative AI (GenAI) systems is challenging because many targets of evaluation are broad, contested concepts, such as "reasoning," "fairness," or "creativity." When the…
Statistical Guarantees in the Search for Less Discriminatory Algorithms
Chris Hays, Ben Laufer, Solon Barocas +1
U.S. discrimination law can impose liability on firms that fail to adopt a less discriminatory alternative (LDA): a decision policy that achieves the same business objectives while…
Effects of Generative AI Errors on User Reliance Across Task Difficulty
Jacy Reese Anthis, Hannah Cha, Solon Barocas +2
The capabilities of artificial intelligence (AI) lie along a jagged frontier, where AI systems surprisingly fail on tasks that humans find easy and succeed on tasks that humans fin…