Efficient N:M Sparse DNN Training Using Algorithm, Architecture, and Dataflow Co-Design

Chao Fang, Wei Sun, Aojun Zhou +1

Sparse training is one of the promising techniques to reduce the computational cost of DNNs while retaining high accuracy. In particular, N:M fine-grained structured sparsity, wher…