Transformers self-organize like newborn visual systems when trained in prenatal worlds

Lalit Pandey, Samantha M. W. Wood, Justin N. Wood

Do transformers learn like brains? A key challenge in addressing this question is that transformers and brains are trained on fundamentally different data. Brains are initially "tr…