Recurrent In-Context Learning for Tabular Foundation Models

Tejas Vaidhya, Gaurav Sahu, Irina Rish

Tabular foundation models adapt to new datasets through in-context learning (ICL), and, like most transformers, they tie computational depth to the number of independently paramete…