Outlining Traceability: A Principle for Operationalizing Accountability in Computing Systems

Abstract

Accountability is widely understood as a goal for well governed computer systems, and is a sought-after value in many governance contexts. But how can it be achieved? Recent work on standards for governable artificial intelligence systems offers a related principle: traceability. Traceability requires establishing not only how a system worked but how it was created and for what purpose, in a way that explains why a system has particular dynamics or behaviors. It connects records of how the system was constructed and what the system did mechanically to the broader goals of governance, in a way that highlights human understanding of that mechanical operation and the decision processes underlying it. We examine the various ways in which the principle of traceability has been articulated in AI principles and other policy documents from around the world, distill from these a set of requirements on software systems driven by the principle, and systematize the technologies available to meet those requirements. From our map of requirements to supporting tools, techniques, and procedures, we identify gaps and needs separating what traceability requires from the toolbox available for practitioners. This map reframes existing discussions around accountability and transparency, using the principle of traceability to show how, when, and why transparency can be deployed to serve accountability goals and thereby improve the normative fidelity of systems and their development processes.

arXiv commentTo be published in the Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT'21)

References in corpus (17)

• Towards A Rigorous Science of Interpretable Machine Learning
• Model Cards for Model Reporting
• Principles alone cannot guarantee ethical AI
• An introduction to Docker for reproducible research, with examples from the R environment
• Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices
• 'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisions
• Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness
• Problem Formulation and Fairness
• Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
• Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects
• The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standards
• This Thing Called Fairness: Disciplinary Confusion Realizing a Value in Technology
• Developing Bug-Free Machine Learning Systems With Formal Mathematics
• Putting Fairness Principles into Practice: Challenges, Metrics, and Improvements
• Extending the Machine Learning Abstraction Boundary: A Complex Systems Approach to Incorporate Societal Context
• An Algorithmic Equity Toolkit for Technology Audits by Community Advocates and Activists
• Fairness as a Program Property