Comparative and Interpretative Analysis of CNN and Transformer Models in Predicting Wildfire Spread Using Remote Sensing Data

Abstract

Facing the escalating threat of global wildfires, numerous computer vision techniques using remote sensing data have been applied in this area. However, the selection of deep learning methods for wildfire prediction remains uncertain due to the lack of comparative analysis in a quantitative and explainable manner, crucial for improving prevention measures and refining models. This study aims to thoroughly compare the performance, efficiency, and explainability of four prevalent deep learning architectures: Autoencoder, ResNet, UNet, and Transformer-based Swin-UNet. Employing a real-world dataset that includes nearly a decade of remote sensing data from California, U.S., these models predict the spread of wildfires for the following day. Through detailed quantitative comparison analysis, we discovered that Transformer-based Swin-UNet and UNet generally outperform Autoencoder and ResNet, particularly due to the advanced attention mechanisms in Transformer-based Swin-UNet and the efficient use of skip connections in both UNet and Transformer-based Swin-UNet, which contribute to superior predictive accuracy and model interpretability. Then we applied XAI techniques on all four models, this not only enhances the clarity and trustworthiness of models but also promotes focused improvements in wildfire prediction capabilities. The XAI analysis reveals that UNet and Transformer-based Swin-UNet are able to focus on critical features such as 'Previous Fire Mask', 'Drought', and 'Vegetation' more effectively than the other two models, while also maintaining balanced attention to the remaining features, leading to their superior performance. The insights from our thorough comparative analysis offer substantial implications for future model design and also provide guidance for model selection in different scenarios.

References in corpus (12)

• Adam: A Method for Stochastic Optimization
• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• A Unified Approach to Interpreting Model Predictions
• Axiomatic Attribution for Deep Networks
• Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation
• A review of wildland fire spread modelling, 1990-present, 1: Physical and quasi-physical models
• Next Day Wildfire Spread: A Machine Learning Data Set to Predict Wildfire Spreading from Remote-Sensing Data
• Interpreted machine learning in fluid dynamics: Explaining relaminarisation events in wall-bounded shear flows
• Finding the right XAI method -- A Guide for the Evaluation and Ranking of Explainable AI Methods in Climate Science
• Carefully choose the baseline: Lessons learned from applying XAI attribution methods for regression tasks in geoscience
• Deep Learning for Wildfire Risk Prediction: Integrating Remote Sensing and Environmental Data
• Explainable AI Integrated Feature Engineering for Wildfire Prediction