Convolutional unitary or orthogonal recurrent neural networks

Marcelo O. Magnasco

Recurrent neural networks are extremely powerful yet hard to train. One of their issues is the vanishing gradient problem, whereby propagation of training signals may be exponentia…