Relating transformers to models and neural representations of the hippocampal formation

James C. R. Whittington, Joseph Warren, Timothy E. J. Behrens

Many deep neural network architectures loosely based on brain networks have recently been shown to replicate neural firing patterns observed in the brain. One of the most exciting…