2 citations · 2 across the 2 of their papers we have counts for
2 papers
cs.CL2024
LongSSM: On the Length Extension of State-space Models in Language Modelling
Shida Wang
In this paper, we investigate the length-extension of state-space models (SSMs) in language modeling. Length extension involves training models on short sequences and testing them…
cs.LG2023★ 2 cited
State-space Models with Layer-wise Nonlinearity are Universal Approximators with Exponential Decaying Memory
Shida Wang, Beichen Xue
State-space models have gained popularity in sequence modelling due to their simple and efficient network structures. However, the absence of nonlinear activation along the tempora…