Convergence Analysis and Implicit Regularization of Feedback Alignment for Deep Linear Networks

Manuela Girotti, Ioannis Mitliagkas, Gauthier Gidel

We theoretically analyze the Feedback Alignment (FA) algorithm, an efficient alternative to backpropagation for training neural networks. We provide convergence guarantees with rat…