Breaking the Memory Wall: Exact Analytical Differentiation via Tiled Operator-Space Evolution

Shuhuan Wang, Yuzhen Xie, Jiayi Li +1

Selective State Space Models (SSMs) achieve linear-time inference, yet their gradient-based sensitivity analysis remains bottlenecked by O(L) memory scaling during backpropagation.…