Arbitrary-Length Generalization for Addition in a Tiny Transformer

Alexandre Galvao Patriota

This paper introduces a novel training methodology that enables a Transformer model to generalize the addition of two-digit numbers to numbers with unseen lengths of digits. The pr…