AI, Help Me Think$\unicode{x2014}$but for Myself: Assisting People in Complex Decision-Making by Providing Different Kinds of Cognitive Support
arXiv:2504.06771 · doi:10.1145/3706598.3713295
Abstract
How can we design AI tools that effectively support human decision-making by complementing and enhancing users' reasoning processes? Common recommendation-centric approaches face challenges such as inappropriate reliance or a lack of integration with users' decision-making processes. Here, we explore an alternative interaction model in which the AI outputs build upon users' own decision-making rationales. We compare this approach, which we call ExtendAI, with a recommendation-based AI. Participants in our mixed-methods user study interacted with both AIs as part of an investment decision-making task. We found that the AIs had different impacts, with ExtendAI integrating better into the decision-making process and people's own thinking and leading to slightly better outcomes. RecommendAI was able to provide more novel insights while requiring less cognitive effort. We discuss the implications of these and other findings along with three tensions of AI-assisted decision-making which our study revealed.
To be published at ACM CHI 2025 Conference on Human Factors in Computing Systems
References in corpus (14)
- To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-making
- Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Making
- On Human Predictions with Explanations and Predictions of Machine Learning Models: A Case Study on Deception Detection
- Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systems
- Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanations
- The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of AI-Generated Text But Self-Declare as Authors
- Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lens
- Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning
- Rethinking Human-AI Collaboration in Complex Medical Decision Making: A Case Study in Sepsis Diagnosis
- Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiology
- Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Process
- Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making
- XAI for All: Can Large Language Models Simplify Explainable AI?
- Ironies of Generative AI: Understanding and mitigating productivity loss in human-AI interactions