Length Generalization Bounds for Transformers

Andy Yang, Pascal Bergsträßer, Georg Zetzsche +2

Length generalization is a key property of a learning algorithm that enables it to make correct predictions on inputs of any length, given finite training data. To provide such a g…