Allocating Recurrent Compute in Looped Language Models

Ruhai Lin, Yiyang Guo, Rui-Jie Zhu +2

Looped language models improve reasoning and knowledge manipulation by applying shared computation repeatedly. Existing systems usually repeat an entire layer stack, although a mix…