Transformers and Cortical Waves: Encoders for Pulling In Context Across Time

Lyle Muller, Patricia S. Churchland, Terrence J. Sejnowski

The capabilities of transformer networks such as ChatGPT and other Large Language Models (LLMs) have captured the world's attention. The crucial computational mechanism underlying…