A Meta-Analysis of the Utility of Explainable Artificial Intelligence in Human-AI Decision-Making

Abstract

Research in artificial intelligence (AI)-assisted decision-making is experiencing tremendous growth with a constantly rising number of studies evaluating the effect of AI with and without techniques from the field of explainable AI (XAI) on human decision-making performance. However, as tasks and experimental setups vary due to different objectives, some studies report improved user decision-making performance through XAI, while others report only negligible effects. Therefore, in this article, we present an initial synthesis of existing research on XAI studies using a statistical meta-analysis to derive implications across existing research. We observe a statistically positive impact of XAI on users' performance. Additionally, the first results indicate that human-AI decision-making tends to yield better task performance on text data. However, we find no effect of explanations on users' performance compared to sole AI predictions. Our initial synthesis gives rise to future research investigating the underlying causes and contributes to further developing algorithms that effectively benefit human decision-makers by providing meaningful explanations.

AAAI/ACM Conference on AI, Ethics, and Society (AIES'22)

References in corpus (2)

• Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Making
• Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Setting

Cited by in corpus (9)

• When combinations of humans and AI are useful: A systematic review and meta-analysis
• Human-AI Collaboration: The Effect of AI Delegation on Human Task Performance and Task Satisfaction
• Explanations, Fairness, and Appropriate Reliance in Human-AI Decision-Making
• The Impact of Imperfect XAI on Human-AI Decision-Making
• Fostering Appropriate Reliance on Large Language Models: The Role of Explanations, Sources, and Inconsistencies
• How explainable AI affects human performance: A systematic review of the behavioural consequences of saliency maps
• Unraveling the Dilemma of AI Errors: Exploring the Effectiveness of Human and Machine Explanations for Large Language Models
• Negotiating the Shared Agency between Humans & AI in the Recommender System
• It's only fair when I think it's fair: How Gender Bias Alignment Undermines Distributive Fairness in Human-AI Collaboration