Towards a theory of learning dynamics in deep state space models

Jakub Smékal, Jimmy T. H. Smith, Michael Kleinman +2

State space models (SSMs) have shown remarkable empirical performance on many long sequence modeling tasks, but a theoretical understanding of these models is still lacking. In thi…