Towards Understanding What State Space Models Learn About Code

Jiali Wu, Abhinav Anand, Shweta Verma +1

State Space Models (SSMs) have emerged as an efficient alternative to the Transformer architecture. Prior work shows that, when trained under comparable conditions, SSMs can match…