Right Direction, Wrong Step: Geometric Analysis of Finite-Step Failure in Looped Transformers

Zhihao Guo, Zonghan Wu, Haizhou Du +4

Looped Transformers offer a parameter-efficient route to test-time scaling by reusing shared layers for iterative latent reasoning. However, additional iterations can reduce suppor…