Understanding Sparse Feature Updates in Deep Networks using Iterative Linearisation

Adrian Goldwaser, Hong Ge

Larger and deeper networks generalise well despite their increased capacity to overfit. Understanding why this happens is theoretically and practically important. One recent approa…