Walking the Walk of AI Ethics: Organizational Challenges and the Individualization of Risk among Ethics Entrepreneurs
arXiv:2305.09573 · doi:10.1145/3593013.3593990
Abstract
Amidst decline in public trust in technology, computing ethics have taken center stage, and critics have raised questions about corporate ethics washing. Yet few studies examine the actual implementation of AI ethics values in technology companies. Based on a qualitative analysis of technology workers tasked with integrating AI ethics into product development, we find that workers experience an environment where policies, practices, and outcomes are decoupled. We analyze AI ethics workers as ethics entrepreneurs who work to institutionalize new ethics-related practices within organizations. We show that ethics entrepreneurs face three major barriers to their work. First, they struggle to have ethics prioritized in an environment centered around software product launches. Second, ethics are difficult to quantify in a context where company goals are incentivized by metrics. Third, the frequent reorganization of teams makes it difficult to access knowledge and maintain relationships central to their work. Consequently, individuals take on great personal risk when raising ethics issues, especially when they come from marginalized backgrounds. These findings shed light on complex dynamics of institutional change at technology companies.
10 pages, to be published in ACM FAccT '23
References in corpus (2)
Cited by in corpus (9)
- Farsight: Fostering Responsible AI Awareness During AI Application Prototyping
- Misty: UI Prototyping Through Interactive Conceptual Blending
- The Value-Sensitive Conversational Agent Co-Design Framework
- "You Cannot Sound Like GPT": Signs of language discrimination and resistance in computer science publishing
- Ethics Pathways: A Design Activity for Reflecting on Ethics Engagement in HCI Research
- Supporting Industry Computing Researchers in Assessing, Articulating, and Addressing the Potential Negative Societal Impact of Their Work
- Towards Creating Infrastructures for Values and Ethics Work in the Production of Software Technologies
- Identifying the Barriers to Human-Centered Design in the Workplace: Perspectives from UX Professionals
- Organization Matters: A Qualitative Study of Organizational Dynamics in Red Teaming Practices for Generative AI