Bridging the Transparency Gap: What Can Explainable AI Learn From the AI Act?
arXiv:2302.10766 · doi:10.3233/FAIA230367
Abstract
The European Union has proposed the Artificial Intelligence Act which introduces detailed requirements of transparency for AI systems. Many of these requirements can be addressed by the field of explainable AI (XAI), however, there is a fundamental difference between XAI and the Act regarding what transparency is. The Act views transparency as a means that supports wider values, such as accountability, human rights, and sustainable innovation. In contrast, XAI views transparency narrowly as an end in itself, focusing on explaining complex algorithmic properties without considering the socio-technical context. We call this difference the ``transparency gap''. Failing to address the transparency gap, XAI risks leaving a range of transparency issues unaddressed. To begin to bridge this gap, we overview and clarify the terminology of how XAI and European regulation -- the Act and the related General Data Protection Regulation (GDPR) -- view basic definitions of transparency. By comparing the disparate views of XAI and regulation, we arrive at four axes where practical work could bridge the transparency gap: defining the scope of transparency, clarifying the legal status of XAI, addressing issues with conformity assessment, and building explainability for datasets.
Accepted in European Conference on Artificial Intelligence (ECAI) 2023
References in corpus (4)
- A Survey on the Explainability of Supervised Machine Learning
- What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Research
- Metrics for Explainable AI: Challenges and Prospects
- A Human-Centric Assessment Framework for AI
Cited by in corpus (5)
- Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Review
- AI Safety for Everyone
- Building Symbiotic AI: Reviewing the AI Act for a Human-Centred, Principle-Based Framework
- People Attribute Purpose to Autonomous Vehicles When Explaining Their Behavior: Insights from Cognitive Science for Explainable AI
- The Contribution of XAI for the Safe Development and Certification of AI: An Expert-Based Analysis