Bayesian learning of orthogonal embeddings for multi-fidelity Gaussian Processes

Abstract

We present a Bayesian approach to identify optimal transformations that map model input points to low dimensional latent variables. The "projection" mapping consists of an orthonormal matrix that is considered a priori unknown and needs to be inferred jointly with the GP parameters, conditioned on the available training data. The proposed Bayesian inference scheme relies on a two-step iterative algorithm that samples from the marginal posteriors of the GP parameters and the projection matrix respectively, both using Markov Chain Monte Carlo (MCMC) sampling. In order to take into account the orthogonality constraints imposed on the orthonormal projection matrix, a Geodesic Monte Carlo sampling algorithm is employed, that is suitable for exploiting probability measures on manifolds. We extend the proposed framework to multi-fidelity models using GPs including the scenarios of training multiple outputs together. We validate our framework on three synthetic problems with a known lower-dimensional subspace. The benefits of our proposed framework, are illustrated on the computationally challenging three-dimensional aerodynamic optimization of a last-stage blade for an industrial gas turbine, where we study the effect of an 85-dimensional airfoil shape parameterization on two output quantities of interest, specifically on the aerodynamic efficiency and the degree of reaction.

References in corpus (10)

• Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data
• Machine Learning of Linear Differential Equations using Gaussian Processes
• Active subspace methods in theory and practice: applications to kriging surfaces
• Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification
• Geodesic Monte Carlo on Embedded Manifolds
• Compressive sensing adaptation for polynomial chaos expansions
• Reduced Wiener Chaos representation of random fields via basis adaptation and projection
• Structured Bayesian Gaussian process latent variable model: applications to data-driven dimensionality reduction and high-dimensional inversion
• Active Learning of Linear Embeddings for Gaussian Processes
• Sparse Polynomial Chaos expansions using Variational Relevance Vector Machines

Cited by in corpus (3)

• Sequential Bayesian experimental design for estimation of extreme-event probability in stochastic dynamical systems
• Variational Inference for Nonlinear Inverse Problems via Neural Net Kernels: Comparison to Bayesian Neural Networks, Application to Topology Optimization
• Variational Bayesian surrogate modelling with application to robust design optimisation