output
20222026
most citedWhy do tree-based models still outperform deep learning on tabular data?

159 citations

15 papers

cs.LG2026

Counterfactual learning of new adaptive instructional policies using logged data

Samuel Girard, Sein Minn, Amel Bouzeghoub +1

Optimizing instructional policies in Intelligent Tutoring Systems (ITS) typically requires costly online experimentation or student simulators that may fail to capture real-world d…

cs.CY2026

Estimating Learners' Skill Acquisition Without Temporal Information

Ryosuke Nagai, Kyohei Atarashi, Koh Takeuchi +2

Recent research in educational data mining, especially knowledge tracing, has focused on predicting learners' future knowledge states to support adaptive instruction. However, in m…

cs.IR2026

Adaptive Quality-Diversity Trade-offs for Large-Scale Batch Recommendation

Clémence Réda, Tomas Rigaux, Hiba Bederina +3

A core research question in recommender systems is to propose batches of highly relevant and diverse items, that is, items personalized to the user's preferences, but which also mi…

cs.LG2026

Live Knowledge Tracing: Real-Time Adaptation using Tabular Foundation Models

Mounir Lbath, Alexandre Parésy, Abdelkayoum Kaddouri +2

Deep knowledge tracing models have achieved significant breakthroughs in modeling student learning trajectories. However, these architectures require substantial training time and…

stat.ME2026

On the calibration of survival models with competing risks

Julie Alberge, Tristan Haugomat, Gaël Varoquaux +1

Survival analysis deals with modeling the time until an event occurs, and accurate probability estimates are crucial for decision-making, particularly in the competing-risks settin…

cs.AI2024

A Pre-Trained Graph-Based Model for Adaptive Sequencing of Educational Documents

Jean Vassoyan, Anan Schütt, Jill-Jênn Vie +3

Massive Open Online Courses (MOOCs) have greatly contributed to making education more accessible. However, many MOOCs maintain a rigid, one-size-fits-all structure that fails to ad…

stat.ML2024★ 2 cited

Survival Models: Proper Scoring Rule and Stochastic Optimization with Competing Risks

Julie Alberge, Vincent Maladière, Olivier Grisel +2

When dealing with right-censored data, where some outcomes are missing due to a limited observation period, survival analysis -- known as time-to-event analysis -- focuses on predi…

cs.AI2024★ 3 cited

Imputation for prediction: beware of diminishing returns

Marine Le Morvan, Gaël Varoquaux

Missing values are prevalent across various fields, posing challenges for training and deploying predictive models. In this context, imputation is a common practice, driven by the…

cs.AI2024

Teaching Models To Survive: Proper Scoring Rule and Stochastic Optimization with Competing Risks

Julie Alberge, Vincent Maladière, Olivier Grisel +2

When data are right-censored, i.e. some outcomes are missing due to a limited period of observation, survival analysis can compute the "time to event". Multiple classes of outcomes…

cs.LG2024

Towards Efficient and Optimal Covariance-Adaptive Algorithms for Combinatorial Semi-Bandits

Julien Zhou, Pierre Gaillard, Thibaud Rahier +2

We address the problem of stochastic combinatorial semi-bandits, where a player selects among P actions from the power set of a set containing d base items. Adaptivity to the probl…

stat.ML2023

Vectorizing string entries for data processing on tables: when are larger language models better?

Léo Grinsztajn, Edouard Oyallon, Myung Jun Kim +1

There are increasingly efficient data processing pipelines that work on vectors of numbers, for instance most machine learning models, or vector databases for fast similarity searc…

cs.CY2023

Deep Knowledge Tracing is an implicit dynamic multidimensional item response theory model

Jill-Jênn Vie, Hisashi Kashima

Knowledge tracing consists in predicting the performance of some students on new questions given their performance on previous questions, and can be a prior step to optimizing asse…

stat.ME2023★ 1 cited

Causal thinking for decision making on Electronic Health Records: why and how

Matthieu Doutreligne, Tristan Struja, Judith Abecassis +3

Accurate predictions, as with machine learning, may not suffice to provide optimal healthcare for every patient. Indeed, prediction can be driven by shortcuts in the data, such as…

cs.LG2022★ 5 cited

Beyond calibration: estimating the grouping loss of modern neural networks

Alexandre Perez-Lebel, Marine Le Morvan, Gaël Varoquaux

The ability to ensure that a classifier gives reliable confidence scores is essential to ensure informed decision-making. To this end, recent work has focused on miscalibration, i.…

cs.LG2022★ 159 cited

Why do tree-based models still outperform deep learning on tabular data?

Léo Grinsztajn, Edouard Oyallon, Gaël Varoquaux

While deep learning has enabled tremendous progress on text and image datasets, its superiority on tabular data is not clear. We contribute extensive benchmarks of standard and nov…