Projection-based multifidelity linear regression for data-scarce applications

Abstract

Surrogate modeling for systems with high-dimensional quantities of interest remains challenging, particularly when training data are costly to acquire. This work develops multifidelity methods for multiple-input multiple-output linear regression targeting data-limited applications with high-dimensional outputs. Multifidelity methods integrate many inexpensive low-fidelity model evaluations with limited, costly high-fidelity evaluations. We introduce two projection-based multifidelity linear regression approaches with linear and nonlinear features that leverage principal component basis vectors for dimensionality reduction and combine multifidelity data through: (i) a direct data augmentation using low-fidelity data, and (ii) a data augmentation incorporating explicit linear corrections between low-fidelity and high-fidelity data. The data augmentation approaches combine high-fidelity and low-fidelity data into a unified training set and train the linear regression model through weighted least squares with fidelity-specific weights. We introduce a proximity-based weighting scheme with automatic weight selection strategy through cross-validation. The proposed multifidelity linear regression methods are demonstrated on approximating the surface pressure field of a hypersonic vehicle in flight and the temperature field on an aircraft disc braking system. In an ultra low-data regime of no more than twelve high-fidelity samples, multifidelity linear regression achieves approximately 2%-12% improvement in median accuracy and a higher $R^2$ score relative to single-fidelity methods at comparable computational cost.

36 pages, 16 figures, accepted in Machine Learning for Computational Science and Engineering special issue Accelerating Numerical Methods With Scientific Machine Learning

References in corpus (6)

• Machine learning and the physical sciences
• A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems
• Construction of arbitrary order finite element degree-of-freedom maps on polygonal and polyhedral cell meshes
• Multi-fidelity regression using artificial neural networks: efficient approximation of parameter-dependent output quantities
• Multi-fidelity surrogate modeling using long short-term memory networks
• Identifying key differences between linear stochastic estimation and neural networks for fluid flow regressions