Low-Rank Approximation of Structural Redundancy for Self-Supervised Learning

Kang Du, Yu Xiang

We study the data-generating mechanism for reconstructive SSL to shed light on its effectiveness. With an infinite amount of labeled samples, we provide a sufficient and necessary…