High-Order Optimization of Gradient Boosted Decision Trees

Jean Pachebat, Sergei Ivanov

Gradient Boosted Decision Trees (GBDTs) are dominant machine learning algorithms for modeling discrete or tabular data. Unlike neural networks with millions of trainable parameters…