13 citations · 26 across the 9 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.CL2020★ 2 cited
How Far Does BERT Look At:Distance-based Clustering and Analysis of BERTs Attention
Yue Guan, Jingwen Leng, Chao Li +2
Recent research on the multi-head attention mechanism, especially that in pre-trained models such as BERT, has shown us heuristics and clues in analyzing various aspects of the mec…
cs.DC2020★ 13 cited
Accelerating Sparse DNN Models without Hardware-Support via Tile-Wise Sparsity
Cong Guo, Bo Yang Hsueh, Jingwen Leng +7
Network pruning can reduce the high computation cost of deep neural network (DNN) models. However, to maintain their accuracies, sparse models often carry randomly-distributed weig…