Progressive Disclosure: Designing for Effective Transparency

Abstract

As we increasingly delegate important decisions to intelligent systems, it is essential that users understand how algorithmic decisions are made. Prior work has often taken a technocentric approach to transparency. In contrast, we explore empirical user-centric methods to better understand user reactions to transparent systems. We assess user reactions to global and incremental feedback in two studies. In Study 1, users anticipated that the more transparent incremental system would perform better, but retracted this evaluation after experience with the system. Qualitative data suggest this may arise because incremental feedback is distracting and undermines simple heuristics users form about system operation. Study 2 explored these effects in depth, suggesting that users may benefit from initially simplified feedback that hides potential system errors and assists users in building working heuristics about system operation. We use these findings to motivate new progressive disclosure principles for transparency in intelligent systems.

arXiv admin note: text overlap with arXiv:1811.02163

References in corpus (8)

• A Unified Approach to Interpreting Model Predictions
• Methods for Interpreting and Understanding Deep Neural Networks
• European Union regulations on algorithmic decision-making and a "right to explanation"
• Equality of Opportunity in Supervised Learning
• "Why Should I Trust You?": Explaining the Predictions of Any Classifier
• RetainVis: Visual Analytics with Interpretable and Interactive Recurrent Neural Networks on Electronic Medical Records
• "What is Relevant in a Text Document?": An Interpretable Machine Learning Approach
• Dice in the Black Box: User Experiences with an Inscrutable Algorithm