Input-Output Equivalence of Unitary and Contractive RNNs

M. Emami, M. Sahraee-Ardakan, S. Rangan +1

Unitary recurrent neural networks (URNNs) have been proposed as a method to overcome the vanishing and exploding gradient problem in modeling data with long-term dependencies. A ba…