What Functions Does XGBoost Learn?

Dohyeong Ki, Adityanand Guntuboyina

This paper establishes a rigorous theoretical foundation for the function class implicitly learned by XGBoost, bridging the gap between its empirical success and our theoretical un…