Enhanced Structured State Space Models via Grouped FIR Filtering and Attention Sink Mechanisms

Tian Meng, Yang Tao, Wuliang Yin

Structured State Space Models (SSMs) have emerged as compelling alternatives to Transformer architectures, offering linear-time complexity and superior performance in various seque…