Generalization vs. Memorization in the Presence of Statistical Biases in Transformers

John Mitros

This study aims to understand how statistical biases affect the model's ability to generalize to in-distribution and out-of-distribution data on algorithmic tasks. Prior research i…