collaborators

1 paper

cs.LG2025

Linear Attention Sequence Parallelism

Weigao Sun, Zhen Qin, Dong Li +3

Sequence parallelism (SP) serves as a prevalent strategy to handle long sequences that exceed the memory limit of a single device. However, for linear sequence modeling methods lik…