Linear Range in Gradient Descent

Angxiu Ni, Chaitanya Talnikar

This paper defines linear range as the range of parameter perturbations which lead to approximately linear perturbations in the states of a network. We compute linear range from th…