12 citations · 16 across the 3 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2022★ 2 cited
Dynamic N:M Fine-grained Structured Sparse Attention Mechanism
Zhaodong Chen, Yuying Quan, Zheng Qu +3
Transformers are becoming the mainstream solutions for various tasks like NLP and Computer vision. Despite their success, the high complexity of the attention mechanism hinders the…
cs.LG2021★ 12 cited
Transformer Acceleration with Dynamic Sparse Attention
Liu Liu, Zheng Qu, Zhaodong Chen +2
Transformers are the mainstream of NLP applications and are becoming increasingly popular in other domains such as Computer Vision. Despite the improvements in model quality, the e…