Weight decay induced phase transitions in multilayer neural networks

M. Ahr, M. Biehl, E. Schloesser

We investigate layered neural networks with differentiable activation function and student vectors without normalization constraint by means of equilibrium statistical physics. We…