Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous media

Abstract

We propose Physics-Aware Neural Implicit Solvers (PANIS), a novel, data-driven framework for learning surrogates for parametrized Partial Differential Equations (PDEs). It consists of a probabilistic, learning objective in which weighted residuals are used to probe the PDE and provide a source of {\em virtual} data i.e. the actual PDE never needs to be solved. This is combined with a physics-aware implicit solver that consists of a much coarser, discretized version of the original PDE, which provides the requisite information bottleneck for high-dimensional problems and enables generalization in out-of-distribution settings (e.g. different boundary conditions). We demonstrate its capability in the context of random heterogeneous materials where the input parameters represent the material microstructure. We extend the framework to multiscale problems and show that a surrogate can be learned for the effective (homogenized) solution without ever solving the reference problem. We further demonstrate how the proposed framework can accommodate and generalize several existing learning objectives and architectures while yielding probabilistic surrogates that can quantify predictive uncertainty.

References in corpus (30)

• Adam: A Method for Stochastic Optimization
• Variational Inference: A Review for Statisticians
• DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators
• DGM: A deep learning algorithm for solving partial differential equations
• Solving high-dimensional partial differential equations using deep learning
• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• Fourier Neural Operator for Parametric Partial Differential Equations
• Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data
• Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
• hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decomposition
• Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification
• Weak Adversarial Networks for High-dimensional Partial Differential Equations
• Adversarial Uncertainty Quantification in Physics-Informed Neural Networks
• Deep convolutional encoder-decoder networks for uncertainty quantification of dynamic multiphase flow in heterogeneous media
• Discovering Symbolic Models from Deep Learning with Inductive Biases
• Multiscale modeling of inelastic materials with Thermodynamics-based Artificial Neural Networks (TANN)
• Physics-Informed Neural Operator for Learning Partial Differential Equations
• Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solvers
• A Deep Neural Network Surrogate for High-Dimensional Random Partial Differential Equations
• Equivariant Flows: Exact Likelihood Generative Learning for Symmetric Densities
• GFINNs: GENERIC Formalism Informed Neural Networks for Deterministic and Stochastic Dynamical Systems
• Thermodynamics-informed graph neural networks
• A physics-aware, probabilistic machine learning framework for coarse-graining high-dimensional systems in the Small Data regime
• Convolutional Neural Operators for robust and accurate learning of PDEs
• Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systems
• Wavelet neural operator: a neural operator for parametric partial differential equations
• Deep Residual Learning and PDEs on Manifold
• Fully probabilistic deep models for forward and inverse problems in parametric PDEs
• A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observables
• Variational Bayes Deep Operator Network: A data-driven Bayesian solver for parametric differential equations