Explainable AI-Based Interface System for Weather Forecasting Model
arXiv:2504.00795 · doi:10.1007/978-3-031-48057-7_7
Abstract
Machine learning (ML) is becoming increasingly popular in meteorological decision-making. Although the literature on explainable artificial intelligence (XAI) is growing steadily, user-centered XAI studies have not extend to this domain yet. This study defines three requirements for explanations of black-box models in meteorology through user studies: statistical model performance for different rainfall scenarios to identify model bias, model reasoning, and the confidence of model outputs. Appropriate XAI methods are mapped to each requirement, and the generated explanations are tested quantitatively and qualitatively. An XAI interface system is designed based on user feedback. The results indicate that the explanations increase decision utility and user trust. Users prefer intuitive explanations over those based on XAI algorithms even for potentially easy-to-recognize examples. These findings can provide evidence for future research on user-centered XAI algorithms, as well as a basis to improve the usability of AI systems in practice.
19 pages, 16 figures
References in corpus (7)
- Interpretable machine learning: definitions, methods, and applications
- Skillful Precipitation Nowcasting using Deep Generative Models of Radar
- Questioning the AI: Informing Design Practices for Explainable AI User Experiences
- A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Concepts
- Data-driven medium-range weather prediction with a Resnet pretrained on climate simulations: A new model for WeatherBench
- The Need for Ethical, Responsible, and Trustworthy Artificial Intelligence for Environmental Sciences
- Effective Training Strategies for Deep-learning-based Precipitation Nowcasting and Estimation