A Differential Geometry Perspective on Orthogonal Recurrent Models

Omri Azencot, N. Benjamin Erichson, Mirela Ben-Chen +1

Recently, orthogonal recurrent neural networks (RNNs) have emerged as state-of-the-art models for learning long-term dependencies. This class of models mitigates the exploding and…