Phase transitions reveal hierarchical structure in deep neural networks

Ibrahim Talha Ersoy, Andrés Fernando Cardozo Licha, Karoline Wiesner

Training Deep Neural Networks relies on the model converging on a high-dimensional, non-convex loss landscape toward a good minimum. Yet, much of the phenomenology of training rema…