Explain My Surprise: Learning Efficient Long-Term Memory by Predicting Uncertain Outcomes

Artyom Sorokin, Nazar Buzun, Leonid Pugachev +1

In many sequential tasks, a model needs to remember relevant events from the distant past to make correct predictions. Unfortunately, a straightforward application of gradient base…