Flash PD-SSM: Memory-Optimized Structured Sparse State-Space Models

Aleksandar Terzić, Francesco Carzaniga, Nicolas Menet +4

State-space models (SSMs) face a fundamental trade-off between efficiency and expressivity that is mainly dictated by the structure of the model's transition matrix. Unstructured t…