Out-of-distribution Tests Reveal Compositionality in Chess Transformers

Anna Mészáros, Patrik Reizinger, Ferenc Huszár

Chess is a canonical example of a task that requires rigorous reasoning and long-term planning. Modern decision Transformers - trained similarly to LLMs - are able to learn compete…