RRA: Recurrent Residual Attention for Sequence Learning

Cheng Wang

In this paper, we propose a recurrent neural network (RNN) with residual attention (RRA) to learn long-range dependencies from sequential data. We propose to add residual connectio…