Predictive Representation Learning for Language Modeling

Qingfeng Lan, Luke Kumar, Martha White +1

To effectively perform the task of next-word prediction, long short-term memory networks (LSTMs) must keep track of many types of information. Some information is directly related…