Transformer Acceleration with Dynamic Sparse Attention

Liu Liu, Zheng Qu, Zhaodong Chen +2

Transformers are the mainstream of NLP applications and are becoming increasingly popular in other domains such as Computer Vision. Despite the improvements in model quality, the e…