Multi-timescale Representation Learning in LSTM Language Models

Shivangi Mahto, Vy A. Vo, Javier S. Turek +1

Language models must capture statistical dependencies between words at timescales ranging from very short to very long. Earlier work has demonstrated that dependencies in natural l…