Incorporating Exponential Smoothing into MLP: A Simple but Effective Sequence Model

Jiqun Chu, Zuoquan Lin

Modeling long-range dependencies in sequential data is a crucial step in sequence learning. A recently developed model, the Structured State Space (S4), demonstrated significant ef…