The Fallacy of AI Functionality

Abstract

Deployed AI systems often do not work. They can be constructed haphazardly, deployed indiscriminately, and promoted deceptively. However, despite this reality, scholars, the press, and policymakers pay too little attention to functionality. This leads to technical and policy solutions focused on "ethical" or value-aligned deployments, often skipping over the prior question of whether a given system functions, or provides any benefits at all. To describe the harms of various types of functionality failures, we analyze a set of case studies to create a taxonomy of known AI functionality issues. We then point to policy and organizational responses that are often overlooked and become more readily available once functionality is drawn into focus. We argue that functionality is a meaningful AI policy challenge, operating as a necessary first step towards protecting affected communities from algorithmic harm.

References in corpus (11)

• Explaining and Harnessing Adversarial Examples
• Problem Formulation and Fairness
• The Hidden Assumptions Behind Counterfactual Explanations and Principal Reasons
• Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects
• Measuring Robustness to Natural Distribution Shifts in Image Classification
• Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing
• Runaway Feedback Loops in Predictive Policing
• The effect of differential victim crime reporting on predictive policing systems
• ABOUT ML: Annotation and Benchmarking on Understanding and Transparency of Machine Learning Lifecycles
• Beyond Near- and Long-Term: Towards a Clearer Account of Research Priorities in AI Ethics and Society
• Measurement as governance in and for responsible AI

Cited by in corpus (4)

• Harms from Increasingly Agentic Algorithmic Systems
• The Dark Side of Dataset Scaling: Evaluating Racial Classification in Multimodal Models
• Toward Operationalizing Pipeline-aware ML Fairness: A Research Agenda for Developing Practical Guidelines and Tools
• Counterfactual Prediction Under Outcome Measurement Error