InRank: Incremental Low-Rank Learning

Jiawei Zhao, Yifei Zhang, Beidi Chen +2

The theory of greedy low-rank learning (GLRL) aims to explain the impressive generalization capabilities of deep learning. It proves that stochastic gradient-based training implici…