Counting and Algorithmic Generalization with Transformers

Simon Ouellette, Rolf Pfister, Hansueli Jud

Algorithmic generalization in machine learning refers to the ability to learn the underlying algorithm that generates data in a way that generalizes out-of-distribution. This is ge…