A Technical Note on the Architectural Effects on Maximum Dependency Lengths of Recurrent Neural Networks

Jonathan S. Kent, Michael M. Murray

This work proposes a methodology for determining the maximum dependency length of a recurrent neural network (RNN), and then studies the effects of architectural changes, including…