Data-driven polynomial chaos expansion for machine learning regression

Abstract

We present a regression technique for data-driven problems based on polynomial chaos expansion (PCE). PCE is a popular technique in the field of uncertainty quantification (UQ), where it is typically used to replace a runnable but expensive computational model subject to random inputs with an inexpensive-to-evaluate polynomial function. The metamodel obtained enables a reliable estimation of the statistics of the output, provided that a suitable probabilistic model of the input is available. Machine learning (ML) regression is a research field that focuses on providing purely data-driven input-output maps, with the focus on pointwise prediction accuracy. We show that a PCE metamodel purely trained on data can yield pointwise predictions whose accuracy is comparable to that of other ML regression models, such as neural networks and support vector machines. The comparisons are performed on benchmark datasets available from the literature. The methodology also enables the quantification of the output uncertainties, and is robust to noise. Furthermore, it enjoys additional desirable properties, such as good performance for small training sets and simplicity of construction, with only little parameter tuning required.

References in corpus (17)

• Rejoinder to "Least angle regression" by Efron et al
• Least Angle Regression
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Practical Bayesian Optimization of Machine Learning Algorithms
• Hyperparameter Search in Machine Learning
• Quantifying Uncertainty in Random Forests via Confidence Intervals and Hypothesis Tests
• A machine learning approach for efficient uncertainty quantification using multiscale methods
• Polynomial Chaos Expansion for general multivariate distributions with correlated variables
• Additive Approximations in High Dimensional Nonparametric Regression via the SALSA
• Parallel Computing for Copula Parameter Estimation with Big Data: A Simulation Study

Cited by in corpus (25)

• Uncertainty Quantification in Machine Learning for Engineering Design and Health Prognostics: A Tutorial
• Euclid preparation: IX. EuclidEmulator2 -- Power spectrum emulation with massive neutrinos and self-consistent dark energy perturbations
• Emulation of stochastic simulators using generalized lambda models
• Seismic fragility analysis using stochastic polynomial chaos expansions
• A spectral surrogate model for stochastic simulators computed from trajectory samples
• Regression-based sparse polynomial chaos for uncertainty quantification of subsurface flow models
• A physics and data co-driven surrogate modeling method for high-dimensional rare event simulation
• Rare event estimation using stochastic spectral embedding
• Bayesian model inversion using stochastic spectral embedding
• Machine learning applied to simulations of collisions between rotating, differentiated planets
• Multivariate sensitivity-adaptive polynomial chaos expansion for high-dimensional surrogate modeling and uncertainty quantification
• Bayesian tomography with prior-knowledge-based parametrization and surrogate modeling
• Dynamic graph and polynomial chaos based models for contact tracing data analysis and optimal testing prescription
• Physically interpretable machine learning algorithm on multidimensional non-linear fields
• Emulator-based Bayesian Inference on Non-Proportional Scintillation Models by Compton-Edge Probing
• Power Module Heat Sink Design Optimization with Ensembles of Data-Driven Polynomial Chaos Surrogate Models
• Extending classical surrogate modelling to high-dimensions through supervised dimensionality reduction: a data-driven approach
• Data-Driven Sensitivity Indices for Models With Dependent Inputs Using the Polynomial Chaos Expansion
• Neural Chaos: A Spectral Stochastic Neural Operator
• A Resolution Independent Neural Operator
• Replication-based emulation of the response distribution of stochastic simulators using generalized lambda distributions
• Stochastic spectral embedding
• Global sensitivity analysis using derivative-based sparse Poincaré chaos expansions
• A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems
• Surrogate-based variational data assimilation for tidal modelling