LoopAhead: Speculating Ahead for Faster Decoding in Looped Language Models

Zixuan Liu, Nan Xue, Rui Bao +4

Looped Transformers improve parameter efficiency by repeatedly applying the same Transformer layers. However, generating each token still involves sequential computation and repeat…