Ethics-Based Auditing of Automated Decision-Making Systems: Nature, Scope, and Limitations

Abstract

Important decisions that impact human lives, livelihoods, and the natural environment are increasingly being automated. Delegating tasks to so-called automated decision-making systems (ADMS) can improve efficiency and enable new solutions. However, these benefits are coupled with ethical challenges. For example, ADMS may produce discriminatory outcomes, violate individual privacy, and undermine human self-determination. New governance mechanisms are thus needed that help organisations design and deploy ADMS in ways that are ethical, while enabling society to reap the full economic and social benefits of automation. In this article, we consider the feasibility and efficacy of ethics-based auditing (EBA) as a governance mechanism that allows organisations to validate claims made about their ADMS. Building on previous work, we define EBA as a structured process whereby an entity's present or past behaviour is assessed for consistency with relevant principles or norms. We then offer three contributions to the existing literature. First, we provide a theoretical explanation of how EBA can contribute to good governance by promoting procedural regularity and transparency. Second, we propose seven criteria for how to design and implement EBA procedures successfully. Third, we identify and discuss the conceptual, technical, social, economic, organisational, and institutional constraints associated with EBA. We conclude that EBA should be considered an integral component of multifaced approaches to managing the ethical risks posed by ADMS.

arXiv commentArtificial Intelligence, Auditing, Automated Decision-Making, Ethics, Governance

References in corpus (10)

• Artificial Intelligence: the global landscape of ethics guidelines
• Model Cards for Model Reporting
• The Ethics of AI Ethics -- An Evaluation of Guidelines
• Artificial Intelligence, Values and Alignment
• Society-in-the-Loop: Programming the Algorithmic Social Contract
• Ethics-Based Auditing to Develop Trustworthy AI
• CERTIFAI: Counterfactual Explanations for Robustness, Transparency, Interpretability, and Fairness of Artificial Intelligence models
• Designing for Human Rights in AI
• Challenges of Scaled Agile for Safety-Critical Systems
• Ethically Aligned Design of Autonomous Systems: Industry viewpoint and an empirical study

Cited by in corpus (9)

• Conformity Assessments and Post-market Monitoring: A Guide to the Role of Auditing in the Proposed European AI Regulation
• Auditing of AI: Legal, Ethical and Technical Approaches
• Operationalising AI governance through ethics-based auditing: An industry case study
• Ethics-Based Auditing of Automated Decision-Making Systems: Intervention Points and Policy Implications
• How to Assess Trustworthy AI in Practice
• Frontier AI developers need an internal audit function
• The Switch, the Ladder, and the Matrix: Models for Classifying AI Systems
• Enhancing Trust Through Standards: A Comparative Risk-Impact Framework for Aligning ISO AI Standards with Global Ethical and Regulatory Contexts
• Fairness in Ranking under Disparate Uncertainty