PAR: Progress-Aligned Recurrence for Length Generalization in State Tracking

Pan Wang, Yihao Hu, Guangyuan Dong +8

Looped language models can run more iterations at test time, but additional iterations need not help them solve longer problems. For sequential state tracking, final-answer supervi…