Give Me a Choice: The Consequences of Restricting Choices Through AI-Support for Perceived Autonomy, Motivational Variables, and Decision Performance
arXiv:2410.07728 · doi:10.1145/3805689.3812265
Abstract
Design optimizations in human-AI collaboration often focus on cognitive aspects like attention and task load. Drawing on work design literature, we propose that effective human-AI collaboration requires broader consideration of human needs (e.g., autonomy) that affect motivational variables (e.g., meaningfulness). In a simulated drone oversight experiment, participants (N=274, between-subject) faced 10 critical decision-making scenarios with varying levels of choice restrictions with an AI recommending only 1, 2, 4 or all 6 possible actions. Restricting participants to one selectable action improved task performance (with a perfect AI) but significantly reduced perceived autonomy and work meaningfulness, and these effects intensified over time. In conditions with multiple action choices, participants with higher perceived autonomy performed better. The findings underscore the importance of considering motivational factors to design successful long-term human-AI collaboration at work.
24 pages, 5 figures
References in corpus (23)
- To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-making
- Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Making
- What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Research
- Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directions
- When combinations of humans and AI are useful: A systematic review and meta-analysis
- Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systems
- The Flaws of Policies Requiring Human Oversight of Government Algorithms
- How does HCI Understand Human Autonomy and Agency?
- Understanding the Effect of Out-of-distribution Examples and Interactive Explanations on Human-AI Decision Making
- Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systems
- Improving Human-AI Collaboration With Descriptions of AI Behavior
- Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAI
- On the Quest for Effectiveness in Human Oversight: Interdisciplinary Perspectives
- Human Perceptions on Moral Responsibility of AI: A Case Study in AI-Assisted Bail Decision-Making
- Explanations, Fairness, and Appropriate Reliance in Human-AI Decision-Making
- Seamful XAI: Operationalizing Seamful Design in Explainable AI
- Accuracy-Time Tradeoffs in AI-Assisted Decision Making under Time Pressure
- AI, Help Me Think$\unicode{x2014}$but for Myself: Assisting People in Complex Decision-Making by Providing Different Kinds of Cognitive Support
- Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Process
- Beyond Recommender: An Exploratory Study of the Effects of Different AI Roles in AI-Assisted Decision Making
- Design Considerations for Human Oversight of AI: Insights from Co-Design Workshops and Work Design Theory
- Understanding and Predicting Temporal Visual Attention Influenced by Dynamic Highlights in Monitoring Task
- A Task-Driven Human-AI Collaboration: When to Automate, When to Collaborate, When to Challenge