Dissociating Decodability and Causal Use in Bracket-Sequence Transformers

Aryan Sharma, Cutter Dawes, Shivam Raval

When trained on tasks requiring an understanding of hierarchical structure, transformers have been found to represent this hierarchy in distinct ways: in the geometry of the residu…