Learning Pruned Structure and Weights Simultaneously from Scratch: an Attention based Approach

Qisheng He, Weisong Shi, Ming Dong

As a deep learning model typically contains millions of trainable weights, there has been a growing demand for a more efficient network structure with reduced storage space and imp…