Disentangling Feature Structure: A Mathematically Provable Two-Stage Training Dynamics in Transformers

Zixuan Gong, Shijia Li, Yong Liu +1

Transformers may exhibit two-stage training dynamics during the real-world training process. For instance, when training GPT-2 on the Counterfact dataset, the answers progress from…