Non-normal spectral signatures of instability in neural network training dynamics

Souvik Ghosh

Training instabilities in deep networks - loss spikes, oscillatory convergence, and gradient pathologies - are empirically prevalent but lack a rigorous operator-theoretic explanat…