Learning Functional Priors and Posteriors from Data and Physics

Abstract

We develop a new Bayesian framework based on deep neural networks to be able to extrapolate in space-time using historical data and to quantify uncertainties arising from both noisy and gappy data in physical problems. Specifically, the proposed approach has two stages: (1) prior learning and (2) posterior estimation. At the first stage, we employ the physics-informed Generative Adversarial Networks (PI-GAN) to learn a functional prior either from a prescribed function distribution, e.g., Gaussian process, or from historical data and physics. At the second stage, we employ the Hamiltonian Monte Carlo (HMC) method to estimate the posterior in the latent space of PI-GANs. In addition, we use two different approaches to encode the physics: (1) automatic differentiation, used in the physics-informed neural networks (PINNs) for scenarios with explicitly known partial differential equations (PDEs), and (2) operator regression using the deep operator network (DeepONet) for PDE-agnostic scenarios. We then test the proposed method for (1) meta-learning for one-dimensional regression, and forward/inverse PDE problems (combined with PINNs); (2) PDE-agnostic physical problems (combined with DeepONet), e.g., fractional diffusion as well as saturated stochastic (100-dimensional) flows in heterogeneous porous media; and (3) spatial-temporal regression problems, i.e., inference of a marine riser displacement field. The results demonstrate that the proposed approach can provide accurate predictions as well as uncertainty quantification given very limited scattered and noisy data, since historical data could be available to provide informative priors. In summary, the proposed method is capable of learning flexible functional priors, and can be extended to big data problems using stochastic HMC or normalizing flows since the latent space is generally characterized as low dimensional.

References in corpus (2)

• Generative Adversarial Networks
• tfp.mcmc: Modern Markov Chain Monte Carlo Tools Built for Modern Hardware

Cited by in corpus (14)

• A physics-informed variational DeepONet for predicting the crack path in brittle materials
• Bayesian Physics-Informed Neural Networks for real-world nonlinear dynamical systems
• In-Context Operator Learning with Data Prompts for Differential Equation Problems
• A Survey on Physics Informed Reinforcement Learning: Review and Open Problems
• A comprehensive and fair comparison of two neural operators (with practical extensions) based on FAIR data
• A Generative Modeling Framework for Inferring Families of Biomechanical Constitutive Laws in Data-Sparse Regimes
• Real-Time Prediction of Gas Flow Dynamics in Diesel Engines using a Deep Neural Operator Framework
• L-HYDRA: Multi-Head Physics-Informed Neural Networks
• Empowering Bayesian Neural Networks with Functional Priors through Anchored Ensembling for Mechanics Surrogate Modeling Applications
• A Robust Learning Methodology for Uncertainty-aware Scientific Machine Learning models
• G2Φnet: Relating Genotype and Biomechanical Phenotype of Tissues with Deep Learning
• Flow field tomography with uncertainty quantification using a Bayesian physics-informed neural network
• Bayesian neural networks with interpretable priors from Mercer kernels
• Navigating Uncertainties in Machine Learning for Structural Dynamics: A Comprehensive Survey of Probabilistic and Non-Probabilistic Approaches in Forward and Inverse Problems