An Open API Architecture to Discover the Trustworthy Explanation of Cloud AI Services
arXiv:2411.03376 · doi:10.1109/TCC.2024.3398609
Abstract
This article presents the design of an open-API-based explainable AI (XAI) service to provide feature contribution explanations for cloud AI services. Cloud AI services are widely used to develop domain-specific applications with precise learning metrics. However, the underlying cloud AI services remain opaque on how the model produces the prediction. We argue that XAI operations are accessible as open APIs to enable the consolidation of the XAI operations into the cloud AI services assessment. We propose a design using a microservice architecture that offers feature contribution explanations for cloud AI services without unfolding the network structure of the cloud models. We can also utilize this architecture to evaluate the model performance and XAI consistency metrics showing cloud AI services trustworthiness. We collect provenance data from operational pipelines to enable reproducibility within the XAI service. Furthermore, we present the discovery scenarios for the experimental tests regarding model performance and XAI consistency metrics for the leading cloud vision AI services. The results confirm that the architecture, based on open APIs, is cloud-agnostic. Additionally, data augmentations result in measurable improvements in XAI consistency metrics for cloud AI services.
Published in: IEEE Transactions on Cloud Computing ( Volume: 12, Issue: 2, April-June 2024)
References in corpus (5)
- Captum: A unified and generic model interpretability library for PyTorch
- Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directions
- Axiom-based Grad-CAM: Towards Accurate Visualization and Explanation of CNNs
- OmniXAI: A Library for Explainable AI
- XAIport: A Service Framework for the Early Adoption of XAI in AI Model Development