Training Variable Long Sequences with Data-Centric Parallel

Geng Zhang, Xuanlei Zhao, Kai Wang +1

Training deep learning models on variable long sequences poses significant computational challenges. Existing methods force a difficult trade-off between efficiency and ease-of-use…