Do Language Models Track Entities Across State Changes?

Zilu Tang, Qiao Zhao, Gabriel Franco +4

Entity tracking (ET), the ability to keep track of states, is a fundamental skill that underlies complex reasoning. An increasing amount of work investigates how transformer langua…