Dynamics of Local Elasticity During Training of Neural Nets

Soham Dan, Anirbit Mukherjee, Avirup Das +1

In the recent past, a property of neural training trajectories in weight-space had been isolated, that of "local elasticity" (denoted as $S_{\mathrm{rel}}$). Local elasticity attempts t…