Late Transformer Layers Recode Syntax Canonically: Evidence from Greek Scrambling and Cross-Layer Generalisation

Christos Nikolaos Zacharopoulos, Revekka Kyriakoglou, Chara Tsoukala +1

Probing studies have established that syntactic information is decodable in early and middle transformer layers, but what happens to that information in later layers remains poorly…