On Pruning State-Space LLMs

Tamer Ghattas, Michael Hassid, Roy Schwartz

Recent work proposed state-space models (SSMs) as an efficient alternative to transformer-based LLMs. Can these models be pruned to further reduce their computation costs? We adapt…