Random Sampling High Dimensional Model Representation Gaussian Process Regression (RS-HDMR-GPR) for representing multidimensional functions with machine-learned lower-dimensional terms allowing insight with a general method

Abstract

We present a Python implementation for RS-HDMR-GPR (Random Sampling High Dimensional Model Representation Gaussian Process Regression). The method builds representations of multivariate functions with lower-dimensional terms, either as an expansion over orders of coupling or using terms of only a given dimensionality. This facilitates, in particular, recovering functional dependence from sparse data. The code also allows for imputation of missing values of the variables and for a significant pruning of the useful number of HDMR terms. The code can also be used for estimating relative importance of different combinations of input variables, thereby adding an element of insight to a general machine learning method. The capabilities of this regression tool are demonstrated on test cases involving synthetic analytic functions, the potential energy surface of the water molecule, kinetic energy densities of materials (crystalline magnesium, aluminum, and silicon), and financial market data.

47 pages, 13 figures

References in corpus (1)

• Data-driven kinetic energy density fitting for orbital-free DFT: linear vs Gaussian process regression

Cited by in corpus (7)

• Neural network with optimal neuron activation functions based on additive Gaussian process regression
• On the optimization of hyperparameters in Gaussian process regression with the help of low-order high-dimensional model representation
• Easy representation of multivariate functions with low-dimensional terms via Gaussian process regression kernel design: applications to machine learning of potential energy surfaces and kinetic energy densities from sparse data
• Degeneration of kernel regression with Matern kernels into low-order polynomial regression in high dimension
• The loss of the property of locality of the kernel in high-dimensional Gaussian process regression on the example of the fitting of molecular potential energy surfaces
• Orders-of-coupling representation with a single neural network with optimal neuron activation functions and without nonlinear parameter optimization
• Machine learning the screening factor in the soft bond valence approach for rapid crystal structure estimation