Shfl-BW: Accelerating Deep Neural Network Inference with Tensor-Core Aware Weight Pruning

Guyue Huang, Haoran Li, Minghai Qin +3

Weight pruning in deep neural networks (DNNs) can reduce storage and computation cost, but struggles to bring practical speedup to the model inference time. Tensor-cores can signif…