A Mechanistic Analysis of Transformers for Dynamical Systems

Gregory Duthé, Nikolaos Evangelou, Wei Liu +2

Transformers are increasingly adopted for modeling and forecasting time-series, yet their internal mechanisms remain poorly understood from a dynamical systems perspective. In cont…