Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Review

Abstract

Artificial Intelligence (AI) shows promising applications for the perception and planning tasks in autonomous driving (AD) due to its superior performance compared to conventional methods. However, inscrutable AI systems exacerbate the existing challenge of safety assurance of AD. One way to mitigate this challenge is to utilize explainable AI (XAI) techniques. To this end, we present the first comprehensive systematic literature review of explainable methods for safe and trustworthy AD. We begin by analyzing the requirements for AI in the context of AD, focusing on three key aspects: data, model, and agency. We find that XAI is fundamental to meeting these requirements. Based on this, we explain the sources of explanations in AI and describe a taxonomy of XAI. We then identify five key contributions of XAI for safe and trustworthy AI in AD, which are interpretable design, interpretable surrogate models, interpretable monitoring, auxiliary explanations, and interpretable validation. Finally, we propose a modular framework called SafeX to integrate these contributions, enabling explanation delivery to users while simultaneously ensuring the safety of AI models.

References in corpus (13)

• A Survey on the Explainability of Supervised Machine Learning
• What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Research
• A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Concepts
• A Review and Comparative Study on Probabilistic Object Detection in Autonomous Driving
• A Survey of End-to-End Driving: Architectures and Training Methods
• Uncertainty-based Traffic Accident Anticipation with Spatio-Temporal Relational Learning
• Impossibility Theorems for Feature Attribution
• ROAD: The ROad event Awareness Dataset for Autonomous Driving
• Bridging the Transparency Gap: What Can Explainable AI Learn From the AI Act?
• The Application of Driver Models in the Safety Assessment of Autonomous Vehicles: A Survey
• On the Road with 16 Neurons: Mental Imagery with Bio-inspired Deep Neural Networks
• Explainable and Trustworthy Traffic Sign Detection for Safe Autonomous Driving: An Inductive Logic Programming Approach
• Interpretable and Flexible Target-Conditioned Neural Planners For Autonomous Vehicles

Cited by in corpus (6)

• TalkWithMachines: Enhancing Human-Robot Interaction for Interpretable Industrial Robotics Through Large/Vision Language Models
• HAD-Gen: Human-like and Diverse Driving Behavior Modeling for Controllable Scenario Generation
• People Attribute Purpose to Autonomous Vehicles When Explaining Their Behavior: Insights from Cognitive Science for Explainable AI
• Taming Silent Failures: A Framework for Verifiable AI Reliability
• Decoding the Multimodal Maze: A Systematic Review on the Adoption of Explainability in Multimodal Attention-based Models
• Cooperative Safety Intelligence over V2X Networks: A Survey