Symmetry-Aware Feature Learning: A Polynomial Separation for Multi-Index Models

Jivan Waber, Vanessa Piccolo, Yatin Dandi +1

We establish a polynomial sample complexity separation between symmetry-aware and symmetry-agnostic feature learning. We study growing-rank multi-index models with high-dimensional…