A generative pre-trained transformer with Kerr-soliton attention

Lindell M. Williams, Yan Jin, Scott B. Papp

Generative pre-trained transformers (GPTs) have enabled capability-rich language models, but their operation incurs substantial costs in computation, memory, and data movement. A m…