12 citations · 17 across the 2 of their papers we have counts for
3 papers
cs.LG2021★ 12 cited
Transformer Acceleration with Dynamic Sparse Attention
Liu Liu, Zheng Qu, Zhaodong Chen +2
Transformers are the mainstream of NLP applications and are becoming increasingly popular in other domains such as Computer Vision. Despite the improvements in model quality, the e…
cs.LG2020★ 5 cited
Computation on Sparse Neural Networks: an Inspiration for Future Hardware
Fei Sun, Minghai Qin, Tianyun Zhang +3
Neural network models are widely used in solving many challenging problems, such as computer vision, personalized recommendation, and natural language processing. Those models are…
cs.LG2018
L1-Norm Batch Normalization for Efficient Training of Deep Neural Networks
Shuang Wu, Guoqi Li, Lei Deng +3
Batch Normalization (BN) has been proven to be quite effective at accelerating and improving the training of deep neural networks (DNNs). However, BN brings additional computation,…