6 papers
Shaping the Prior: How Synthetic Task Distributions Determine Tabular Foundation Model Quality
Mohamed Bouadi, Nassim Bouarour, Varun Kulkarni +3
What determines the quality of a tabular foundation model? Unlike language or vision, tabular foundation models acquire their inductive biases almost entirely from synthetic pretra…
Distilling Tabular Foundation Models for Structured Health Data
Aditya Tanna, Nassim Bouarour, Mohamed Bouadi +2
Tabular foundation models (TFMs) achieve strong performance on health datasets, but their inference cost and infrastructure requirements limit practical use. We study whether their…
Ensembling Tabular Foundation Models - A Diversity Ceiling And A Calibration Trap
Aditya Tanna, Yash Desai, Pratinav Seth +3
Tabular foundation models (TFMs) now match or beat tuned gradient-boosted trees on a growing fraction of tabular tasks, but no single TFM wins on every dataset. Ensembling is the g…
Pocket Foundation Models: Distilling TFMs into CPU-Ready Gradient-Boosted Trees
Aditya Tanna, Nassim Bouarour, Mohamed Bouadi +2
A fraud scorer needs to answer in under 2 ms. The best tabular foundation models (TFMs) take 151-1,275 ms on GPU. We close this gap by distilling the TFM offline into an XGBoost or…
Data Presentation Over Architecture: Resampling Strategies for Credit Risk Prediction with Tabular Foundation Models
Aditya Tanna, Mitul Solanki, Mohamed Bouadi +3
Credit default prediction is a tabular learning problem with severe class imbalance, heterogeneous features, and tight latency budgets. Tabular Foundation Models (TFMs) approach th…
Optimizing Coverage and Difficulty in Reinforcement Learning for Quiz Composition
Ricardo Pedro Querido Andrade Silva, Nassim Bouarour, Dina Fettache +3
Quiz design is a tedious process that teachers undertake to evaluate the acquisition of knowledge by students. Our goal in this paper is to automate quiz composition from a set of…