Speedrunning Tabular Foundation Model Pretraining

Salih Bora Ozturk, Alexander Pfefferle, Frank Hutter

Pretraining cost is a major bottleneck for research on tabular foundation models, slowing the iteration cycle for new architectures, priors, and optimization ideas. Yet the communi…