Adversarial Testing as a Tool for Interpretability: Length-based Overfitting of Elementary Functions in Transformers

Patrik Zavoral, Dušan Variš, Ondřej Bojar

The Transformer model has a tendency to overfit various aspects of the training data, such as the overall sequence length. We study elementary string edit functions using a defined…