SparseSSM: Efficient Selective Structured State Space Models Can Be Pruned in One-Shot

Kaiwen Tuo, Huan Wang

State-space language models such as Mamba match Transformer quality while permitting linear complexity inference, yet still comprise billions of parameters that hinder deployment.…