Revealing the Utilized Rank of Subspaces of Learning in Neural Networks

Isha Garg, Christian Koguchi, Eshan Verma +1

In this work, we study how well the learned weights of a neural network utilize the space available to them. This notion is related to capacity, but additionally incorporates the i…