Improve Long-term Memory Learning Through Rescaling the Error Temporally

Shida Wang, Zhanglu Yan

This paper studies the error metric selection for long-term memory learning in sequence modelling. We examine the bias towards short-term memory in commonly used errors, including…