Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructure

Abstract

Rising concern for the societal implications of artificial intelligence systems has inspired demands for greater transparency and accountability. However the datasets which empower machine learning are often used, shared and re-used with little visibility into the processes of deliberation which led to their creation. Which stakeholder groups had their perspectives included when the dataset was conceived? Which domain experts were consulted regarding how to model subgroups and other phenomena? How were questions of representational biases measured and addressed? Who labeled the data? In this paper, we introduce a rigorous framework for dataset development transparency which supports decision-making and accountability. The framework uses the cyclical, infrastructural and engineering nature of dataset development to draw on best practices from the software development lifecycle. Each stage of the data development lifecycle yields a set of documents that facilitate improved communication and decision-making, as well as drawing attention the value and necessity of careful data work. The proposed framework is intended to contribute to closing the accountability gap in artificial intelligence systems, by making visible the often overlooked work that goes into dataset creation.

References in corpus (17)

• Playing Atari with Deep Reinforcement Learning
• Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypes
• No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing World
• Data Science as Political Action: Grounding Data Science in a Politics of Justice
• Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints
• Women also Snowboard: Overcoming Bias in Captioning Models
• The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standards
• Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challenges
• Influence of Personality Types in Software Tasks Choices
• Bringing the People Back In: Contesting Benchmark Machine Learning Datasets
• Large image datasets: A pyrrhic win for computer vision?
• ABOUT ML: Annotation and Benchmarking on Understanding and Transparency of Machine Learning Lifecycles
• Metrology for AI: From Benchmarks to Instruments
• SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle
• Towards Traceability in Data Ecosystems using a Bill of Materials Model
• RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipes
• The Limitations of Standardized Science Tests as Benchmarks for Artificial Intelligence Research: Position Paper

Cited by in corpus (9)

• Power to the People? Opportunities and Challenges for Participatory AI
• Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learning
• Understanding accountability in algorithmic supply chains
• Deliberating with AI: Improving Decision-Making for the Future through Participatory AI Design and Stakeholder Deliberation
• The worst of both worlds: A comparative analysis of errors in learning from data in psychology and machine learning
• Potential Societal Biases of ChatGPT in Higher Education: A Scoping Review
• Path To Gain Functional Transparency In Artificial Intelligence With Meaningful Explainability
• Machine Learning Model Development from a Software Engineering Perspective: A Systematic Literature Review
• Optimization's Neglected Normative Commitments