Generalizing Gain Penalization for Feature Selection in Tree-based Models

Bruna Wundervald, Andrew Parnell, Katarina Domijan

We develop a new approach for feature selection via gain penalization in tree-based models. First, we show that previous methods do not perform sufficient regularization and often…