Learning to update Auto-associative Memory in Recurrent Neural Networks for Improving Sequence Memorization

Wei Zhang, Bowen Zhou

Learning to remember long sequences remains a challenging task for recurrent neural networks. Register memory and attention mechanisms were both proposed to resolve the issue with…