activity
20222026
most citedWhy do tree-based models still outperform deep learning on tabular data?

159 citations · 163 across the 5 of their papers we have counts for

collaborators

6 papers

cs.LG2026

Advancing Open and Reproducible Relational Learning: RelArena-, TabPFN-Rel and RPI

Adrian Hayler, Klemens Flöge, Alan Arazi +44

This first release of Prior Labs in relational learning shows our continued commitment to open science. We open-source three pieces of software that we expect to accelerate researc…

cs.LG2025★ 3 cited

TabPFN-2.5: Advancing the State of the Art in Tabular Foundation Models

Léo Grinsztajn, Klemens Flöge, Oscar Key +23

The first tabular foundation model, TabPFN, and its successor TabPFNv2 have impacted tabular AI substantially, with dozens of methods building on it and hundreds of applications ac…

cs.LG2024

Better by Default: Strong Pre-Tuned MLPs and Boosted Trees on Tabular Data

David Holzmüller, Léo Grinsztajn, Ingo Steinwart

For classification and regression on tabular data, the dominance of gradient-boosted decision trees (GBDTs) has recently been challenged by often much slower deep learning methods…

cs.LG2024★ 1 cited

CARTE: Pretraining and Transfer for Tabular Learning

Myung Jun Kim, Léo Grinsztajn, Gaël Varoquaux

Pretrained deep-learning models are the go-to solution for images or text. However, for tabular data the standard is still to train tree-based models. Indeed, transfer learning on…

stat.ML2023

Vectorizing string entries for data processing on tables: when are larger language models better?

Léo Grinsztajn, Edouard Oyallon, Myung Jun Kim +1

There are increasingly efficient data processing pipelines that work on vectors of numbers, for instance most machine learning models, or vector databases for fast similarity searc…

cs.LG2022★ 159 cited

Why do tree-based models still outperform deep learning on tabular data?

Léo Grinsztajn, Edouard Oyallon, Gaël Varoquaux

While deep learning has enabled tremendous progress on text and image datasets, its superiority on tabular data is not clear. We contribute extensive benchmarks of standard and nov…