6.5k citations · 18.4k across the 52 of their papers we have counts for
4 papers · 1 filter
Retrospective: EIE: Efficient Inference Engine on Sparse and Compressed Neural Network
Song Han, Xingyu Liu, Huizi Mao +4
EIE proposed to accelerate pruned and compressed neural networks, exploiting weight sparsity, activation sparsity, and 4-bit weight-sharing in neural network accelerators. Since pu…
PointAcc: Efficient Point Cloud Accelerator
Yujun Lin, Zhekai Zhang, Haotian Tang +2
Deep learning on point clouds plays a vital role in a wide range of applications such as autonomous driving and AR/VR. These applications interact with people in real-time on edge…
SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning
Hanrui Wang, Zhekai Zhang, Song Han
The attention mechanism is becoming increasingly popular in Natural Language Processing (NLP) applications, showing superior performance than convolutional and recurrent architectu…
SpArch: Efficient Architecture for Sparse Matrix Multiplication
Zhekai Zhang, Hanrui Wang, Song Han +1
Generalized Sparse Matrix-Matrix Multiplication (SpGEMM) is a ubiquitous task in various engineering and scientific applications. However, inner product based SpGENN introduces red…