Learning threshold neurons via the "edge of stability"

Kwangjun Ahn, Sébastien Bubeck, Sinho Chewi +3

Existing analyses of neural network training often operate under the unrealistic assumption of an extremely small learning rate. This lies in stark contrast to practical wisdom and…