Causal Latent Workspaces for Looped Transformers

Ilia Zaznov

Reusing a Transformer block across depth increases computation without replicating its parameters, but successive passes have no dedicated state through which positions can exchang…