How and When Random Feedback Works: A Case Study of Low-Rank Matrix Factorization

Shivam Garg, Santosh S. Vempala

The success of gradient descent in ML and especially for learning neural networks is remarkable and robust. In the context of how the brain learns, one aspect of gradient descent t…