Compliant But Unsatisfactory: The Gap Between Auditing Standards and Practices for Probabilistic Genotyping Software

Abstract

AI governance efforts increasingly rely on audit standards: agreed-upon practices for conducting audits. However, poorly designed standards can hide and lend credibility to inadequate systems. We explore how an audit standard's design influences its effectiveness through a case study of ASB 018, a standard for auditing probabilistic genotyping software -- software that the U.S. criminal legal system increasingly uses to analyze DNA samples. Through qualitative analysis of ASB 018 and five audit reports, we identify numerous gaps between the standard's desired outcomes and the auditing practices it enables. For instance, ASB 018 envisions that compliant audits establish restrictions on software use based on observed failures. However, audits can comply without establishing such boundaries. We connect these gaps to the design of the standard's requirements such as vague language and undefined terms. We conclude with recommendations for designing audit standards and evaluating their effectiveness.

20 pages, 2 figures, published at ACM CHI, 2026

References in corpus (15)

• Model Cards for Model Reporting
• Improving fairness in machine learning systems: What do industry practitioners need?
• Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational Practices
• Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystem
• Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics
• This Thing Called Fairness: Disciplinary Confusion Realizing a Value in Technology
• Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits
• A Framework for Assurance Audits of Algorithmic Systems
• Null Compliance: NYC Local Law 144 and the Challenges of Algorithm Accountability
• Sociotechnical Audits: Broadening the Algorithm Auditing Lens to Investigate Targeted Advertising
• A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations
• Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling
• Defending IEEE Software Standards in Federal Criminal Court
• (Beyond) Reasonable Doubt: Challenges that Public Defenders Face in Scrutinizing AI in Court
• Adversarial Scrutiny of Evidentiary Statistical Software