Topological Neural Dynamics: A Neuron-wise Framework for Sequence Modeling

Borui Cai, Yao Zhao

Existing sequence models, including RNNs, LSTMs, continuous-time networks, and Transformers, share a common structural principle: layer-wise dynamics, where all neurons in the same…