NVR: Vector Runahead on NPUs for Sparse Memory Access

Hui Wang, Zhengpeng Zhao, Jing Wang +11

Deep Neural Networks are increasingly leveraging sparsity to reduce the scaling up of model parameter size. However, reducing wall-clock time through sparsity and pruning remains c…