Rotate the Loop: Blockwise Conformality for Looped Transformers

Alexey Zemtsov, Albina Klepach, Vadim Lomshakov +5

Looped transformers reuse one shared block across many recurrent steps, so depth becomes a quantity that can be spent at runtime rather than a stack of distinct layers. Those extra…