Data-driven probability concentration and sampling on manifold

Abstract

A new methodology is proposed for generating realizations of a random vector with values in a finite-dimensional Euclidean space that are statistically consistent with a data set of observations of this vector. The probability distribution of this random vector, while a-priori not known, is presumed to be concentrated on an unknown subset of the Euclidean space. A random matrix is introduced whose columns are independent copies of the random vector and for which the number of columns is the number of data points in the data set. The approach is based on the use of (i) the multidimensional kernel-density estimation method for estimating the probability distribution of the random matrix, (ii) a MCMC method for generating realizations for the random matrix, (iii) the diffusion-maps approach for discovering and characterizing the geometry and the structure of the data set, and (iv) a reduced-order representation of the random matrix, which is constructed using the diffusion-maps vectors associated with the first eigenvalues of the transition matrix relative to the given data set. The convergence aspects of the proposed methodology are analyzed and a numerical validation is explored through three applications of increasing complexity. The proposed method is found to be robust to noise levels and data complexity as well as to the intrinsic dimension of data and the size of experimental data sets. Both the methodology and the underlying mathematical framework presented in this paper contribute new capabilities and perspectives at the interface of uncertainty quantification, statistical data analysis, stochastic modeling and associated statistical inverse problems.

Submitted to Journal of Computational Physics on September 27, 2015

Cited by in corpus (16)

• Digital twin, physics-based model, and machine learning applied to damage detection in structures
• Data-driven surrogates for high dimensional models using Gaussian process regression on the Grassmann manifold
• Manifold learning-based polynomial chaos expansions for high-dimensional surrogate models
• Probabilistic learning on manifolds constrained by nonlinear partial differential equations for small datasets
• Data-driven Uncertainty Quantification in Computational Human Head Models
• Dimensionality reduction can be used as a surrogate model for high-dimensional forward uncertainty quantification
• Grassmannian diffusion maps based surrogate modeling via geometric harmonics
• Probabilistic learning inference of boundary value problem with uncertainties based on Kullback-Leibler divergence under implicit constraints
• GANs and Closures: Micro-Macro Consistency in Multiscale Modeling
• Polynomial Chaos Expansions on Principal Geodesic Grassmannian Submanifolds for Surrogate Modeling and Uncertainty Quantification
• Data driven Dirichlet sampling on manifolds
• Uncertainty Quantification of Graph Convolution Neural Network Models of Evolving Processes
• Normal-bundle Bootstrap
• Environmental Economics and Uncertainty: Review and a Machine Learning Outlook
• Modeling and Simulating Dependence in Networks Using Topological Data Analysis
• A Metric Space for Point Process Excitations