One Model to Loop Them All: Elastic Latent Recurrence for Language Models

Faisal Ladhak, Shantanu Acharya, Santiago Akle Serano +3

A latent recurrent language model applies a shared block of layers repeatedly, so one checkpoint can trade inference compute for accuracy by changing the loop count. At one loop, h…