Just add noise: Debiasing tree-based variable importance in mixed data

Jiahe Li, Omar Melikechi

Variable importance scores from tree-based methods such as random forests favor continuous predictors over categorical ones. We present a theoretical analysis of this bias and prop…