Learning on dynamic statistical manifolds

Abstract

Hyperbolic balance laws with uncertain (random) parameters and inputs are ubiquitous in science and engineering. Quantification of uncertainty in predictions derived from such laws, and reduction of predictive uncertainty via data assimilation, remain an open challenge. That is due to nonlinearity of governing equations, whose solutions are highly non-Gaussian and often discontinuous. To ameliorate these issues in a computationally efficient way, we use the method of distributions, which here takes the form of a deterministic equation for spatiotemporal evolution of the cumulative distribution function (CDF) of the random system state, as a means of forward uncertainty propagation. Uncertainty reduction is achieved by recasting the standard loss function, i.e., discrepancy between observations and model predictions, in distributional terms. This step exploits the equivalence between minimization of the square error discrepancy and the Kullback-Leibler divergence. The loss function is regularized by adding a Lagrangian constraint enforcing fulfillment of the CDF equation. Minimization is performed sequentially, progressively updating the parameters of the CDF equation as more measurements are assimilated.

17 pages, 8 figures

References in corpus (2)

• Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data
• Information Geometry Aspects of Minimum Entropy Production Paths from Quantum Mechanical Evolutions

Cited by in corpus (6)

• Markov Chain Monte Carlo with Neural Network Surrogates: Application to Contaminant Source Identification
• Deep Learning for Simultaneous Inference of Hydraulic and Transport Properties
• Data-Driven Discovery of Coarse-Grained Equations
• Thermal experiments for fractured rock characterization: theoretical analysis and inverse modeling
• Information-geometry of physics-informed statistical manifolds and its use in data assimilation
• Information geometry and Bose-Einstein condensation