Human-like fleeting memory improves language learning but impairs reading time prediction in transformer language models

Abishek Thamma, Micha Heilbron

Human memory is fleeting. As words are processed, the exact wordforms that make up incoming sentences are rapidly lost. Cognitive scientists have long believed that this limitation…