adaQN: An Adaptive Quasi-Newton Algorithm for Training RNNs

Nitish Shirish Keskar, Albert S. Berahas

Recurrent Neural Networks (RNNs) are powerful models that achieve exceptional performance on several pattern recognition problems. However, the training of RNNs is a computationall…