Computing active subspaces with Monte Carlo

Abstract

Active subspaces can effectively reduce the dimension of high-dimensional parameter studies enabling otherwise infeasible experiments with expensive simulations. The key components of active subspace methods are the eigenvectors of a symmetric, positive semidefinite matrix whose elements are the average products of partial derivatives of the simulation's input/output map. We study a Monte Carlo method for approximating the eigenpairs of this matrix. We offer both theoretical results based on recent non-asymptotic random matrix theory and a practical approach based on the bootstrap. We extend the analysis to the case when the gradients are approximated, for example, with finite differences. Our goal is to provide guidance for two questions that arise in active subspaces: (i) How many gradient samples does one need to accurately approximate the eigenvalues and subspaces? (ii) What can be said about the accuracy of the estimated subspace, both theoretically and practically? We test the approach on both simple quadratic functions where the active subspace is known and a parameterized PDE with 100 variables characterizing the coefficients of the differential operator.

Cited by in corpus (19)

• Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification
• Exploiting Active Subspaces to Quantify Uncertainty in the Numerical Simulation of the HyShot II Scramjet
• Simulator-free Solution of High-Dimensional Stochastic Elliptic Partial Differential Equations using Deep Neural Networks
• Combined parameter and model reduction of cardiovascular problems by means of active subspaces and POD-Galerkin methods
• A near-stationary subspace for ridge approximation
• Surrogate assisted active subspace and active subspace assisted surrogate -- A new paradigm for high dimensional structural reliability analysis
• Bayesian calibration and sensitivity analysis for a karst aquifer model using active subspaces
• Learning High-Dimensional Parametric Maps via Reduced Basis Adaptive Residual Networks
• Bayesian model and dimension reduction for uncertainty propagation: applications in random media
• Model Reduction Framework with a New Take on Active Subspaces for Optimization Problems with Linearized Fluid-Structure Interaction Constraints
• Efficient parameter estimation for a methane hydrate model with active subspaces
• Dimension reduction for Gaussian process emulation: an application to the influence of bathymetry on tsunami heights
• An efficient shape parametrisation by free-form deformation enhanced by active subspace for hull hydrodynamic ship design problems in open source environment
• Data-driven dimensional analysis: algorithms for unique and relevant dimensionless groups
• Computer Model Emulation with High-Dimensional Functional Output in Large-Scale Observing System Uncertainty Experiments
• Microstructure-Aware Bayesian Materials Design
• A Lanczos-Stieltjes method for one-dimensional ridge function approximation and integration
• Dimension reduction in MHD power generation models: dimensional analysis and active subspaces
• A probabilistic framework for approximating functions in active subspaces