Training Trajectories Determine Circuit Removability in Annealable Soft-Prior Transformers

Zonglin Yang, Ziming Zhao, Wei Tang +5

Soft positional priors can help small Transformers learn retrieval circuits, but it is unclear whether the resulting circuits remain functional once the prior is removed. We test t…