A local approach to parameter space reduction for regression and classification tasks

Abstract

Parameter space reduction has been proved to be a crucial tool to speed-up the execution of many numerical tasks such as optimization, inverse problems, sensitivity analysis, and surrogate models' design, especially when in presence of high-dimensional parametrized systems. In this work we propose a new method called local active subspaces (LAS), which explores the synergies of active subspaces with supervised clustering techniques in order to carry out a more efficient dimension reduction in the parameter space. The clustering is performed without losing the input-output relations by introducing a distance metric induced by the global active subspace. We present two possible clustering algorithms: K-medoids and a hierarchical top-down approach, which is able to impose a variety of subdivision criteria specifically tailored for parameter space reduction tasks. This method is particularly useful for the community working on surrogate modelling. Frequently, the parameter space presents subdomains where the objective function of interest varies less on average along different directions. So, it could be approximated more accurately if restricted to those subdomains and studied separately. We tested the new method over several numerical experiments of increasing complexity, we show how to deal with vectorial outputs, and how to classify the different regions with respect to the local active subspace dimension. Employing this classification technique as a preprocessing step in the parameter space, or output space in case of vectorial outputs, brings remarkable results for the purpose of surrogate modelling.

References in corpus (20)

• API design for machine learning software: experiences from the scikit-learn project
• User-friendly tail bounds for sums of random matrices
• Faster k-Medoids Clustering: Improving the PAM, CLARA, and CLARANS Algorithms
• A non-intrusive approach for the reconstruction of POD modal coefficients through active subspaces
• Combined parameter and model reduction of cardiovascular problems by means of active subspaces and POD-Galerkin methods
• Hull shape design optimization with parameter space and model reductions, and self-learning mesh morphing
• Dimension reduction in heterogeneous parametric spaces with application to naval engineering shape design problems
• A multi-fidelity approach coupling parameter space reduction and non-intrusive POD with application to structural optimization of passenger ship hulls
• A supervised learning approach involving active subspaces for an efficient genetic algorithm in high-dimensional optimization problems
• An integrated data-driven computational pipeline with model order reduction for industrial and applied mathematics
• Enhancing CFD predictions in shape design problems by model and parameter space reduction
• Advances in Reduced Order Methods for Parametric Industrial Problems in Computational Fluid Dynamics
• Basic Ideas and Tools for Projection-Based Model Reduction of Parametric Partial Differential Equations
• Model Reduction Framework with a New Take on Active Subspaces for Optimization Problems with Linearized Fluid-Structure Interaction Constraints
• ATHENA: Advanced Techniques for High Dimensional Parameter Spaces to Enhance Numerical Analysis
• Kernel-based active subspaces with application to computational fluid dynamics parametric problems using the discontinuous Galerkin method
• Multi-fidelity data fusion through parameter space reduction with applications to automotive engineering
• Active Manifolds: A non-linear analogue to Active Subspaces
• Multi-fidelity data fusion for the approximation of scalar functions with low intrinsic dimensionality through active subspaces
• Generalized bounds for active subspaces

Cited by in corpus (2)

• ATHENA: Advanced Techniques for High Dimensional Parameter Spaces to Enhance Numerical Analysis
• Multi-fidelity data fusion through parameter space reduction with applications to automotive engineering