Fine-tuned In-Context Learning Transformers are Excellent Tabular Data Classifiers

Felix den Breejen, Sangmin Bae, Stephen Cha +1

The recently introduced TabPFN pretrains an In-Context Learning (ICL) transformer on synthetic data to perform tabular data classification. In this work, we extend TabPFN to the fi…