How many degrees of freedom do we need to train deep networks: a loss landscape perspective

Brett W. Larsen, Stanislav Fort, Nic Becker +1

A variety of recent works, spanning pruning, lottery tickets, and training within random subspaces, have shown that deep neural networks can be trained using far fewer degrees of f…