From Objectives to What Models Learn: A Landau Theory of Invariant Learning

Pinli Wang, Yue He, Peng Cui

Invariant-learning objectives pursue similar goals yet produce qualitatively different regularization paths, leaving unclear when shortcuts can be suppressed without damaging stabl…