Explanation Strategies as an Empirical-Analytical Lens for Socio-Technical Contextualization of Machine Learning Interpretability
arXiv:2109.11849 · doi:10.1145/3492858
Abstract
During a research project in which we developed a machine learning (ML) driven visualization system for non-ML experts, we reflected on interpretability research in ML, computer-supported collaborative work and human-computer interaction. We found that while there are manifold technical approaches, these often focus on ML experts and are evaluated in decontextualized empirical studies. We hypothesized that participatory design research may support the understanding of stakeholders' situated sense-making in our project, yet, found guidance regarding ML interpretability inexhaustive. Building on philosophy of technology, we formulated explanation strategies as an empirical-analytical lens explicating how technical explanations mediate the contextual preferences concerning people's interpretations. In this paper, we contribute a report of our proof-of-concept use of explanation strategies to analyze a co-design workshop with non-ML experts, methodological implications for participatory design research, design implications for explanations for non-ML experts and suggest further investigation of technological mediation theories in the ML interpretability space.
Conditionally accepted to ACM Group 2022. 25 pages, 4 figures
References in corpus (8)
- 'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisions
- Expanding Explainability: Towards Social Transparency in AI systems
- Explaining Models: An Empirical Study of How Explanations Impact Fairness Judgment
- Human Factors in Model Interpretability: Industry Practices, Challenges, and Needs
- Explainable AI: Beware of Inmates Running the Asylum Or: How I Learnt to Stop Worrying and Love the Social and Behavioural Sciences
- CheXplain: Enabling Physicians to Explore and UnderstandData-Driven, AI-Enabled Medical Imaging Analysis
- Question-Driven Design Process for Explainable AI User Experiences
- Space of Reasons and Mathematical Model
Cited by in corpus (4)
- The Entoptic Field Camera as Metaphor-Driven Research-through-Design with AI Technologies
- Responding to Generative AI Technologies with Research-through-Design: The Ryelands AI Lab as an Exploratory Study
- The AI-DEC: A Card-based Design Method for User-centered AI Explanations
- Identifying Explanation Needs of End-users: Applying and Extending the XAI Question Bank