most citedState-space Models with Layer-wise Nonlinearity are Universal Approximators with Exponential Decaying Memory

2 citations · 2 across the 2 of their papers we have counts for

collaborators
Showing cs.CLShow all

1 paper · 1 filter

cs.CL2024

LongSSM: On the Length Extension of State-space Models in Language Modelling

Shida Wang

In this paper, we investigate the length-extension of state-space models (SSMs) in language modeling. Length extension involves training models on short sequences and testing them…