Higher Order Recurrent Neural Networks

Rohollah Soltani, Hui Jiang

In this paper, we study novel neural network structures to better model long term dependency in sequential data. We propose to use more memory units to keep track of more preceding…