Compositional Generalization in Autoregressive Models via Logit Composition

Aakash Kumar, Maria Sofia Bucarelli, Emanuele Natale

Composing autoregressive models remains a core challenge in understanding how large language models can combine behaviors or skills learned across tasks. We introduce a new and pri…