Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling

Abstract

Audits are critical mechanisms for identifying the risks and limitations of deployed artificial intelligence (AI) systems. However, the effective execution of AI audits remains incredibly difficult, and practitioners often need to make use of various tools to support their efforts. Drawing on interviews with 35 AI audit practitioners and a landscape analysis of 435 tools, we compare the current ecosystem of AI audit tooling to practitioner needs. While many tools are designed to help set standards and evaluate AI systems, they often fall short in supporting accountability. We outline challenges practitioners faced in their efforts to use AI audit tools and highlight areas for future tool development beyond evaluation -- from harms discovery to advocacy. We conclude that the available resources do not currently support the full scope of AI audit practitioners' needs and recommend that the field move beyond tools for just evaluation and towards more comprehensive infrastructure for AI accountability.

Ojewale, V., Steed, R., Vecchione, B., Birhane, A., & Raji, I. D. (2025). Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling. In CHI Conference on Human Factors in Computing Systems (CHI '25), April 26--May 01, 2025, Yokohama, Japan. ACM, New York, NY, USA, 29 pages

References in corpus (20)

• Improving fairness in machine learning systems: What do industry practitioners need?
• Power to the People? Opportunities and Challenges for Participatory AI
• The Fallacy of AI Functionality
• Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystem
• "Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interaction
• Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviors
• Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics
• Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits
• Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice
• Algorithmic Auditing and Social Justice: Lessons from the History of Audit Studies
• Null Compliance: NYC Local Law 144 and the Challenges of Algorithm Accountability
• Sociotechnical Audits: Broadening the Algorithm Auditing Lens to Investigate Targeted Advertising
• A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations
• On the Legal Compatibility of Fairness Definitions
• The Fall of an Algorithm: Characterizing the Dynamics Toward Abandonment
• International AI Safety Report
• A Safe Harbor for AI Evaluation and Red Teaming
• The right to audit and power asymmetries in algorithm auditing
• "Public(s)-in-the-Loop": Facilitating Deliberation of Algorithmic Decisions in Contentious Public Policy Domains
• Gaps Between Research and Practice When Measuring Representational Harms Caused by LLM-Based Systems

Cited by in corpus (2)

• Impact Assessment Card: Communicating Risks and Benefits of AI Uses
• Compliant But Unsatisfactory: The Gap Between Auditing Standards and Practices for Probabilistic Genotyping Software