Out of Context: Investigating the Bias and Fairness Concerns of "Artificial Intelligence as a Service"

Abstract

"AI as a Service" (AIaaS) is a rapidly growing market, offering various plug-and-play AI services and tools. AIaaS enables its customers (users) - who may lack the expertise, data, and/or resources to develop their own systems - to easily build and integrate AI capabilities into their applications. Yet, it is known that AI systems can encapsulate biases and inequalities that can have societal impact. This paper argues that the context-sensitive nature of fairness is often incompatible with AIaaS' 'one-size-fits-all' approach, leading to issues and tensions. Specifically, we review and systematise the AIaaS space by proposing a taxonomy of AI services based on the levels of autonomy afforded to the user. We then critically examine the different categories of AIaaS, outlining how these services can lead to biases or be otherwise harmful in the context of end-user applications. In doing so, we seek to draw research attention to the challenges of this emerging area.

Accepted to CHI '23: ACM Human Factors in Computing, 2023, Hamburg, Germany

References in corpus (16)

• Equality of Opportunity in Supervised Learning
• Improving fairness in machine learning systems: What do industry practitioners need?
• 'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisions
• Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatment
• Expanding Explainability: Towards Social Transparency in AI systems
• No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing World
• Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing
• This Thing Called Fairness: Disciplinary Confusion Realizing a Value in Technology
• Does Object Recognition Work for Everyone?
• One button machine for automating feature engineering in relational databases
• Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing
• Minimax Pareto Fairness: A Multi Objective Perspective
• AutoAIViz: Opening the Blackbox of Automated Artificial Intelligence with Conditional Parallel Coordinates
• Calibrated Fairness in Bandits
• One Label, One Billion Faces: Usage and Consistency of Racial Categories in Computer Vision
• Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems

Cited by in corpus (2)

• A Design Space for Intelligent and Interactive Writing Assistants
• Position is Power: System Prompts as a Mechanism of Bias in Large Language Models (LLMs)