Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directions

Abstract

As systems based on opaque Artificial Intelligence (AI) continue to flourish in diverse real-world applications, understanding these black box models has become paramount. In response, Explainable AI (XAI) has emerged as a field of research with practical and ethical benefits across various domains. This paper not only highlights the advancements in XAI and its application in real-world scenarios but also addresses the ongoing challenges within XAI, emphasizing the need for broader perspectives and collaborative efforts. We bring together experts from diverse fields to identify open problems, striving to synchronize research agendas and accelerate XAI in practical applications. By fostering collaborative discussion and interdisciplinary cooperation, we aim to propel XAI forward, contributing to its continued success. Our goal is to put forward a comprehensive proposal for advancing XAI. To achieve this goal, we present a manifesto of 27 open problems categorized into nine categories. These challenges encapsulate the complexities and nuances of XAI and offer a road map for future research. For each problem, we provide promising research directions in the hope of harnessing the collective intelligence of interested stakeholders.

References in corpus (29)

• Towards A Rigorous Science of Interpretable Machine Learning
• Diffusion Models in Vision: A Survey
• Unmasking Clever Hans Predictors and Assessing What Machines Really Learn
• What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Research
• TabTransformer: Tabular Data Modeling Using Contextual Embeddings
• From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagation
• On the Explainability of Natural Language Processing Deep Models
• Explainable Artificial Intelligence (XAI) on TimeSeries Data: A Survey
• OpenXAI: Towards a Transparent Evaluation of Model Explanations
• A Survey of Machine Unlearning
• Progress measures for grokking via mechanistic interpretability
• Which Explanation Should I Choose? A Function Approximation Perspective to Characterizing Post Hoc Explanations
• Sparse Visual Counterfactual Explanations in Image Space
• AtMan: Understanding Transformer Predictions Through Memory Efficient Attention Manipulation
• Explainability in reinforcement learning: perspective and position
• Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks
• Bridging the Gap Between Explainable AI and Uncertainty Quantification to Enhance Trustability
• The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networks
• AttnLRP: Attention-Aware Layer-Wise Relevance Propagation for Transformers
• Vertical Federated Learning: A Structured Literature Review
• Going Beyond XAI: A Systematic Survey for Explanation-Guided Learning
• REVEL Framework to measure Local Linear Explanations for black-box models: Deep Learning Image Classification case of study
• Scale Alone Does not Improve Mechanistic Interpretability in Vision Models
• From Robustness to Explainability and Back Again
• Interpreting Neural Networks through the Polytope Lens
• Explainability is NOT a Game
• Can Transformers Learn to Solve Problems Recursively?
• A Study of Compositional Generalization in Neural Models
• Counterfactual Explanations of Concept Drift

Cited by in corpus (23)

• Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction
• Interpretable Clustering: A Survey
• Describe, Transform, Machine Learning: Feature Engineering for Grain Boundaries and Other Variable-Sized Atom Clusters
• What Does Evaluation of Explainable Artificial Intelligence Actually Tell Us? A Case for Compositional and Contextual Validation of XAI Building Blocks
• An Open API Architecture to Discover the Trustworthy Explanation of Cloud AI Services
• Rad4XCNN: a new agnostic method for post-hoc global explanation of CNN-derived features by means of radiomics
• VR-FuseNet: A Fusion of Heterogeneous Fundus Data and Explainable Deep Network for Diabetic Retinopathy Classification
• Euclid preparation. LXVIII. Extracting physical parameters from galaxies with machine learning
• GPT Assisted Annotation of Rhetorical and Linguistic Features for Interpretable Propaganda Technique Detection in News Text
• "Oh LLM, I'm Asking Thee, Please Give Me a Decision Tree": Zero-Shot Decision Tree Induction and Embedding with Large Language Models
• Solving the enigma: Enhancing faithfulness and comprehensibility in explanations of deep networks
• CiteFusion: An Ensemble Framework for Citation Intent Classification Harnessing Dual-Model Binary Couples and SHAP Analyses
• FovEx: Human-Inspired Explanations for Vision Transformers and Convolutional Neural Networks
• Give Me a Choice: The Consequences of Restricting Choices Through AI-Support for Perceived Autonomy, Motivational Variables, and Decision Performance
• Design Considerations for Human Oversight of AI: Insights from Co-Design Workshops and Work Design Theory
• Time Series Information Visualization -- A Review of Approaches and Tools
• Global Counterfactual Directions
• Local Concept Embeddings for Analysis of Concept Distributions in Vision DNN Feature Spaces
• Genetic Programming for Explainable Manifold Learning
• X-SHIELD: Regularization for eXplainable Artificial Intelligence
• Explainability of Algorithms
• Knowledge graphs for empirical concept retrieval
• M3Net: A Macro-to-Meso-to-Micro Clinical-inspired Hierarchical 3D Network for Pulmonary Nodule Classification