Principled Out-of-Distribution Generalization via Simplicity

Jiawei Ge, Amanda Wang, Shange Tang +1

Modern foundation models exhibit remarkable out-of-distribution (OOD) generalization, solving tasks far beyond the support of their training data. However, the theoretical principl…