Mathematical Theory of Collinearity Effects on Machine Learning Variable Importance Measures

Kelvyn K. Bladen, D. Richard Cutler, Alan Wisler

In many machine learning problems, understanding variable importance is a central concern. Two common approaches are Permute-and-Predict (PaP), which randomly permutes a feature in…