Human-AI Collaboration: The Effect of AI Delegation on Human Task Performance and Task Satisfaction
arXiv:2303.09224 · doi:10.1145/3581641.3584052
Abstract
Recent work has proposed artificial intelligence (AI) models that can learn to decide whether to make a prediction for an instance of a task or to delegate it to a human by considering both parties' capabilities. In simulations with synthetically generated or context-independent human predictions, delegation can help improve the performance of human-AI teams -- compared to humans or the AI model completing the task alone. However, so far, it remains unclear how humans perform and how they perceive the task when they are aware that an AI model delegated task instances to them. In an experimental study with 196 participants, we show that task performance and task satisfaction improve through AI delegation, regardless of whether humans are aware of the delegation. Additionally, we identify humans' increased levels of self-efficacy as the underlying mechanism for these improvements in performance and satisfaction. Our findings provide initial evidence that allowing AI models to take over more management responsibilities can be an effective form of human-AI collaboration in workplaces.
28th International Conference on Intelligent User Interfaces (IUI '23)
References in corpus (9)
- To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-making
- Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Making
- Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systems
- The Algorithmic Automation Problem: Prediction, Triage, and Human Effort
- Increasing the Speed and Accuracy of Data LabelingThrough an AI Assisted Interface
- Should I Follow AI-based Advice? Measuring Appropriate Reliance in Human-AI Decision-Making
- Human-AI Collaboration in Decision-Making: Beyond Learning to Defer
- Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibration
- On the Effect of Information Asymmetry in Human-AI Teams