Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learning

Abstract

In 1996, Accountability in a Computerized Society [95] issued a clarion call concerning the erosion of accountability in society due to the ubiquitous delegation of consequential functions to computerized systems. Nissenbaum [95] described four barriers to accountability that computerization presented, which we revisit in relation to the ascendance of data-driven algorithmic systems--i.e., machine learning or artificial intelligence--to uncover new challenges for accountability that these systems present. Nissenbaum's original paper grounded discussion of the barriers in moral philosophy; we bring this analysis together with recent scholarship on relational accountability frameworks and discuss how the barriers present difficulties for instantiating a unified moral, relational framework in practice for data-driven algorithmic systems. We conclude by discussing ways of weakening the barriers in order to do so.

References in corpus (24)

• Explaining and Harnessing Adversarial Examples
• Intriguing properties of neural networks
• Model Cards for Model Reporting
• Equality of Opportunity in Supervised Learning
• Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift
• Performance Metrics (Error Measures) in Machine Learning Regression, Forecasting and Prognostics: Properties and Typology
• Do ImageNet Classifiers Generalize to ImageNet?
• Exploring Generalization in Deep Learning
• WILDS: A Benchmark of in-the-Wild Distribution Shifts
• Problem Formulation and Fairness
• Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing
• Robot Rights? Let's Talk about Human Welfare Instead
• Residual Unfairness in Fair Machine Learning from Prejudiced Data
• Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberation
• Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructure
• An Uncommon Task: Participatory Design in Legal AI
• Designing Accountable Systems
• Reusable Templates and Guides For Documenting Datasets and Models for Natural Language Processing and Generation: A Case Study of the HuggingFace and GEM Data and Model Cards
• Accuracy-Efficiency Trade-Offs and Accountability in Distributed ML Systems
• Model Selection's Disparate Impact in Real-World Deep Learning Applications
• Correctness Verification of Neural Networks
• Asymptotically Optimal Exact Minibatch Metropolis-Hastings
• Fast or Accurate? Governing Conflicting Goals in Highly Autonomous Vehicles
• A relationship and not a thing: A relational approach to algorithmic accountability and assessment documentation

Cited by in corpus (16)

• Harms from Increasingly Agentic Algorithmic Systems
• Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overview
• Blaming Humans and Machines: What Shapes People's Reactions to Algorithmic Harm
• Implementing Responsible AI: Tensions and Trade-Offs Between Ethics Aspects
• From Fitting Participation to Forging Relationships: The Art of Participatory ML
• Non-Determinism and the Lawlessness of Machine Learning Code
• Exploring the Landscape of Ubiquitous In-home Health Monitoring: A Comprehensive Survey
• The "Who", "What", and "How" of Responsible AI Governance: A Systematic Review and Meta-Analysis of (Actor, Stage)-Specific Tools
• Machine Learning practices and infrastructures
• Making the Unaccountable Internet: The Changing Meaning of Accounting in the Early ARPANET
• Being Accountable is Smart: Navigating the Technical and Regulatory Landscape of AI-based Services for Power Grid
• The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systems
• Adversarial Scrutiny of Evidentiary Statistical Software
• From Model Performance to Claim: How a Change of Focus in Machine Learning Replicability Can Help Bridge the Responsibility Gap
• Short paper: Models in the dark -- Rectification and erasure under GDPR in ML supply chains
• How Formerly Incarcerated People Envision Technologies for Prison Parole