A Unified View of Long-Sequence Models towards Modeling Million-Scale Dependencies

Hongyu Hè, Marko Kabic

Ever since their conception, Transformers have taken over traditional sequence models in many tasks, such as NLP, image classification, and video/audio processing, for their fast t…