Failure of entropic selection for diagonal matrix completion in deep linear networks

Rodrigo Treviño

We study the free-energy gradient flow associated with the depth-$N$ deep linear network on the space of invertible real $d\times d$ matrices. The loss observes only the diagonal,…