An explainable transformer circuit for compositional generalization

Cheng Tang, Brenden Lake, Mehrdad Jazayeri

Compositional generalization-the systematic combination of known components into novel structures-remains a core challenge in cognitive science and machine learning. Although trans…