Operationalising AI governance through ethics-based auditing: An industry case study

Abstract

Ethics based auditing (EBA) is a structured process whereby an entitys past or present behaviour is assessed for consistency with moral principles or norms. Recently, EBA has attracted much attention as a governance mechanism that may bridge the gap between principles and practice in AI ethics. However, important aspects of EBA (such as the feasibility and effectiveness of different auditing procedures) have yet to be substantiated by empirical research. In this article, we address this knowledge gap by providing insights from a longitudinal industry case study. Over 12 months, we observed and analysed the internal activities of AstraZeneca, a biopharmaceutical company, as it prepared for and underwent an ethics-based AI audit. While previous literature concerning EBA has focused on proposing evaluation metrics or visualisation techniques, our findings suggest that the main difficulties large multinational organisations face when conducting EBA mirror classical governance challenges. These include ensuring harmonised standards across decentralised organisations, demarcating the scope of the audit, driving internal communication and change management, and measuring actual outcomes. The case study presented in this article contributes to the existing literature by providing a detailed description of the organisational context in which EBA procedures must be integrated to be feasible and effective.

References in corpus (7)

• Artificial Intelligence: the global landscape of ethics guidelines
• Principles alone cannot guarantee ethical AI
• Ethics-Based Auditing to Develop Trustworthy AI
• Ethics-Based Auditing of Automated Decision-Making Systems: Nature, Scope, and Limitations
• Conformity Assessments and Post-market Monitoring: A Guide to the Role of Auditing in the Proposed European AI Regulation
• Institutionalising Ethics in AI through Broader Impact Requirements
• Ethics-Based Auditing of Automated Decision-Making Systems: Intervention Points and Policy Implications

Cited by in corpus (6)

• Auditing large language models: a three-layered approach
• Auditing of AI: Legal, Ethical and Technical Approaches
• Three lines of defense against risks from AI
• Challenges and Best Practices in Corporate AI Governance:Lessons from the Biopharmaceutical Industry
• Frontier AI developers need an internal audit function
• The Switch, the Ladder, and the Matrix: Models for Classifying AI Systems