A Dynamics Theory of Implicit Regularization in Deep Low-Rank Matrix Factorization

Jian Cao, Chen Qian, Yihui Huang +5

Implicit regularization is an important way to interpret neural networks. Recent theory starts to explain implicit regularization with the model of deep matrix factorization (DMF)…