Hamiltonian Deep Neural Networks Guaranteeing Non-vanishing Gradients by Design

Clara Lucía Galimberti, Luca Furieri, Liang Xu +1

Deep Neural Networks (DNNs) training can be difficult due to vanishing and exploding gradients during weight optimization through backpropagation. To address this problem, we propo…