Constructing Gradient Controllable Recurrent Neural Networks Using Hamiltonian Dynamics

Konstantin Rusch, John W. Pearson, Konstantinos C. Zygalakis

Recurrent neural networks (RNNs) have gained a great deal of attention in solving sequential learning problems. The learning of long-term dependencies, however, remains challenging…