Towards Comparative Physical Interpretation of Spatial Variability Aware Neural Networks: A Summary of Results
arXiv:2110.15866
Abstract
Given Spatial Variability Aware Neural Networks (SVANNs), the goal is to investigate mathematical (or computational) models for comparative physical interpretation towards their transparency (e.g., simulatibility, decomposability and algorithmic transparency). This problem is important due to important use-cases such as reusability, debugging, and explainability to a jury in a court of law. Challenges include a large number of model parameters, vacuous bounds on generalization performance of neural networks, risk of overfitting, sensitivity to noise, etc., which all detract from the ability to interpret the models. Related work on either model-specific or model-agnostic post-hoc interpretation is limited due to a lack of consideration of physical constraints (e.g., mass balance) and properties (e.g., second law of geography). This work investigates physical interpretation of SVANNs using novel comparative approaches based on geographically heterogeneous features. The proposed approach on feature-based physical interpretation is evaluated using a case-study on wetland mapping. The proposed physical interpretation improves the transparency of SVANN models and the analytical results highlight the trade-off between model transparency and model performance (e.g., F1-score). We also describe an interpretation based on geographically heterogeneous processes modeled as partial differential equations (PDEs).
arXiv commentSubmission to SIGSPATIAL 2021 peer review process. The document contains 12 pages (including 2 pages of appendix)
References in corpus (8)
- TensorFlow: A system for large-scale machine learning
- A Unified Approach to Interpreting Model Predictions
- DGM: A deep learning algorithm for solving partial differential equations
- Explaining NonLinear Classification Decisions with Deep Taylor Decomposition
- Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
- TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation
- Generalization bounds for deep learning
- Towards Spatial Variability Aware Deep Neural Networks (SVANN): A Summary of Results