Visual Analytics for Explainable and Trustworthy Artificial Intelligence
arXiv:2507.10240 · doi:10.1109/MCG.2025.3533806
Abstract
Our society increasingly depends on intelligent systems to solve complex problems, ranging from recommender systems suggesting the next movie to watch to AI models assisting in medical diagnoses for hospitalized patients. With the iterative improvement of diagnostic accuracy and efficiency, AI holds significant potential to mitigate medical misdiagnoses by preventing numerous deaths and reducing an economic burden of approximately 450 EUR billion annually. However, a key obstacle to AI adoption lies in the lack of transparency: many automated systems function as "black boxes," providing predictions without revealing the underlying processes. This opacity can hinder experts' ability to trust and rely on AI systems. Visual analytics (VA) provides a compelling solution by combining AI models with interactive visualizations. These specialized charts and graphs empower users to incorporate their domain expertise to refine and improve the models, bridging the gap between AI and human understanding. In this work, we define, categorize, and explore how VA solutions can foster trust across the stages of a typical AI pipeline. We propose a design space for innovative visualizations and present an overview of our previously developed VA dashboards, which support critical tasks within the various pipeline stages, including data processing, feature engineering, hyperparameter tuning, understanding, debugging, refining, and comparing models.
References in corpus (4)
- The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizations
- Visualization for Trust in Machine Learning Revisited: The State of the Field in 2023
- HardVis: Visual Analytics to Handle Instance Hardness Using Undersampling and Oversampling Techniques
- DeforestVis: Behavior Analysis of Machine Learning Models with Surrogate Decision Stumps