Glassy dynamics in deep neural networks: A structural comparison

Max Kerr Winter, Liesbeth M. C. Janssen

Deep Neural Networks (DNNs) share important similarities with structural glasses. Both have many degrees of freedom, and their dynamics are governed by a high-dimensional, non-conv…