6 papers
Tailoring Strictly Proper Scoring Rules for Downstream Tasks: An Application to Causal Inference
Roman Plaud, Alexandre Perez-Lebel, Antoine Saillenfest +4
Probabilistic models are typically trained using task-agnostic objectives like log-loss, which can lead to significant errors in downstream estimation. This disconnect is especiall…
STRABLE: Benchmarking Tabular Machine Learning with Strings
Gioia Blayer, Myung Jun Kim, Félix Lefebvre +8
Benchmarking tabular learning has revealed the benefit of dedicated architectures, pushing the state of the art. But real-world tables often contain string entries, beyond numbers,…
TabICLv2: A better, faster, scalable, and open tabular foundation model
Jingang Qu, David Holzmüller, Gaël Varoquaux +1
Tabular foundation models, such as TabPFNv2 and TabICL, have recently dethroned gradient-boosted trees at the top of predictive benchmarks, demonstrating the value of in-context le…
TabICL: A Tabular Foundation Model for In-Context Learning on Large Data
Jingang Qu, David Holzmüller, Gaël Varoquaux +1
The long-standing dominance of gradient-boosted decision trees on tabular data is currently challenged by tabular foundation models using In-Context Learning (ICL): setting the tra…
Decision from Suboptimal Classifiers: Excess Risk Pre- and Post-Calibration
Alexandre Perez-Lebel, Gael Varoquaux, Sanmi Koyejo +2
Probabilistic classifiers are central for making informed decisions under uncertainty. Based on the maximum expected utility principle, optimal decision rules can be derived using…
Imputation for prediction: beware of diminishing returns
Marine Le Morvan, Gaël Varoquaux
Missing values are prevalent across various fields, posing challenges for training and deploying predictive models. In this context, imputation is a common practice, driven by the…