Overcoming Rank Collapse in Feedback Alignment

Gauthier Boeshertz, Razvan Pascanu, Claudia Clopath

Backpropagation (BP) is widely viewed as biologically implausible, in part because it requires feedback weights to be the transpose of forward weights for error propagation. Intere…