Who breaks early, looses: goal oriented training of deep neural networks based on port Hamiltonian dynamics

Julian Burghoff, Marc Heinrich Monells, Hanno Gottschalk

The highly structured energy landscape of the loss as a function of parameters for deep neural networks makes it necessary to use sophisticated optimization strategies in order to…